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ABSTRACT 

This  document  includes  invited  papers  written  for  the 
National  Center  for  Education  Statistics  (NCES)  Elementary/Secondary 
Education  Data  Redesign  Project.  Early  in  1985,  NCES  began  a  thorough 
review  of  its  data  collection  program.  The  purpose  of  the  review  was 
to  address  questions  of  the  suitability,  scope,  reliability,  and 
timeliness  of  statistical  data  in  terms  of  the  purposes  those  data 
serve,  relative  to  instructional  and  administrative  needs  and 
relative  to  education  policy  issues.  To  initiate  the  dialogue,  a 
number  of  individuals  and  organizations  were  invited  to  prepare  a 
paper  following  guidelines  provided  by  NCES.  Individuals  invited  were 
likely  to  (1)  use  quantitative  approaches  in  their  analyses,  and  thus 
be  data  users,  and  (2)  have  the  interest  and  time  to  produce  a 
"thought  paper,"  not  a  research  paper.  There  was  no  intent  to 
represent  known  positions  or  to  provide  balanced  representations 
across  sectors  of  the  education  community.  Organizations  were 
selected  because  of  an  identification  with  education  issues  and 
concerns.  The  results  of  these  efforts  may  well  be  the  design  of  a 
new  plan  for  national  data  collections  from  institutions  and 
individuals  to  be  implemented  over  several  years.  A  total  of  38 
individual  papers,  16  organization  papers,  and  3  agency  papers  are 
included  in  this  volume.  (LMO) 
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PREFACE 


In  early  1985,  the  Center  for  Statistics  began  a  thorough  review  of  Its 
data  collection  program  as  the  Elementary/Secondary  Education  Data 
REDESIGN  Project*    The  purpose  of  this  review  Is  to  address  questions  of 
the  suitability,  scope,  reliability,  and  timeliness  of  CS'  statistical 
data  In  terms  of  the  purposes  those  data  are  expected  to  serve  — 
purposes  relative  to  instructional  and  administrative  needs,  and  to 
education  policy  Issues.    The  result  of  this  effort  may  well  be  the 
design  of  a  new  plan  for  national  data  collections  from  Institutions  and 
Individuals  to  be  implemented  over  several  years. 

To  Initiate  the  dialogue,  a  number  of  individuals  and  organizations 
where  invited  to  prepare  a  paper  following  guidelines  (over  leaf) • 
The  invited  individual  authors  were  persons  likely  to  U)  use 
quantitative  approaches  in  their  analyses,  and  thus  be  data  users,  and 
(b)  have  the  interest  and  time  to  produce  a  "thought  paper",  not  i 
research  paper.    There  was  no  intent  to  represent  known  positions  or  to 
provide  balanced  representation  across  sectors  of  the  education 
community. 

The  organizations  were  selected  because  of  an  identification  with 
education  issues  and  concerns,  and  were  invited  to  participate  in  any  or 
all  stages  of  the  REDESIGN  Project,  including  the  option  of  writing  a 
paper. 

38  invited  individual  papers,  18  organization  papers,  and  3  agency 
papers  are  included  in  this  volune. 

To  facilitate  public  comment  in  response  to,  or  as  stimulated  by  the 
initial  set  of  papers,  OS  asked  a  team  of  writers  to  distill  the  essence 
of  the  papers.    The  product  of  that  effort  was  a  report:    Synthesis  of 
Invited  Papers;    A  Public  Discussion  Draft  (NCES  85-114).    The  purpose 
of  the  Synthesis  report  was  to  represent  in  concise,  coherent  manner  the 
breath  and  content  of  the  invited  papers  which  had  been  received  by 
August  10,  1985.    In  that  way,  particlpanr:s  in  the  REDESIGN  Process  were 
not  required  to  read  the  full  set  of  invited  papers. 


The  Editors 


Guidelines  provided  authors  and  other  participants  in 
the  REDESIGN  Project 


QUESTIONS  BEING  ADDRESSED 

The  authors  were  provided  a  guidance  set  of  questions,  but  advised  that 
those  questions  were  not  meant  to  be  restrictive,  rather  guide  lines  for  the  types 
of  comments  of  interest  to  the  redesign  project  Further,  they  were  asked  for 
possible  survey  questionnaire  items,  specific  measures,  or  indicators  that  could 
improve  future  analyses,  arKj  changes  to  existing  procedures,  definitions,  and 
coverages. 

The  guiding  quMtons  were: 

/.  H^«r  d9t9  or  dSifi  win  «ne  needed  to  support  deliberetions  on  future 
policy  issues,  or  decisions  on  instructional  end  administrative  needs, 
durinn  the  remainder  of  the  20th  century? 
(Link     issues  or  needs  to  the  data  items,) 

Z  \Miat  addhio^l  data  or  data  modifications  -  in  items,  measures,  in- 
dicators, or  samfih  universes/frames  -  wouid  improve  the  utility, 
validity,  or  reliability  of  current  national  data  filn? 
(Identify  the  data  files  and  how  ^y  would  be  improved,) 

3.  Vifhat  current  NC£S  data  aeries  are  most  important  to  m^>ntain  and 


4.  What  current  data  elemants  or  series  are  recommended  to  be  deleted 
from  current  data  programs  and  why? 

5.  What  other  suggestions  are  offered  for  improving  the  relevance,  tech- 
nical quality,  and  utility  of  the  NCES  data  program^ 

ABOUT  THE  PAPERS 

The  charge  given  to  ail  authors  and  organizations  preparing  papers  was 
very  general  in  nature.  All  were  encouraged  to  go  beyond  any  one  spedfic  issue 
or  area  of  major  personal  concent  Authors  have,  in  fact,  been  encouraged  to 
represent  the  breadth  of  issues  in  elementary  and  secofuiary  education. 

For  this  review  -  "Elementary  and  Secondary  Education"  can  Include  edu- 
cational  experiences  from  birth  through  the  transition  to  postsecondary 
education  or  the  workplace.  The  review  can  include  all  educational  ex- 
periences: public  or  private,  in  "schools''  or  other  locations,  organized  or 
not 

For  this  review  -  "National  Data"  can  include  reference  to  any  data  col- 
lections, existing  or  proposed,  and  need  not  be  confined  to  NCES  data 
programs.  For  example,  the  paper  can  discu&i  any  Federal  Government  or 
other  national  education  data  programs,  such  as  the  National  Assessment 
of  Educationa:  Progress  (NAEP),  the  Survey  of  Local  Government  Fi- 
nances (Buruu  of  the  Census  F-33  Series),  or  the  Decennial  Census  of 
Population  and  Housing. 
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REVISING  EDUCATIONAL  STATISTICS 


James  M.  Banner,  Jr. 


Senior  Research  Associate 
council  for  Basic  Education 


It  is  easy  enough,  as  many  have  shown,  to  find  serious 
deficiencies  in  the  gathering  and  presentation  of  educational 
statistics.    Yet  in  reflecting  on  flaws  in  existing  data 
and  on  the  consequences  of  their  weakness,  we  often  lose 
sight  of  the  general  principles  that  should  guide  any 
improvements  and  revirions  of  them.    As  a  prelude  to  some 
specific  concerns  and  at  the  risk  of  reviewing  some  hackneyed 
themes,  I  should  like  to  consider  these  principles,  of  which 
in  my  view  there  are  five. 

The  first  is  that  of  accuracy.    The  raw  data  used  to 
construct  statistical  series  must  be  valid  and  complete; 
their  weaknesses  and  limitations  must  be  specified;  and 
probable  margins  of  error  and  levels  of  confidence  must 
be  stated.    Only  in  this  way  can  faith  in  the  strength  of 
the  statistics  be  raised,  their  utility  increased,  and 
ill-conceived  employment  of  them  — -  for  ideological, 
propaganda,  and  other  ends  —  be  cxirbed. 

Second  to  accuracy  in  order  but  net  in  importamce  is 
the  principle  of  comparability.    Accurate  data  to  not  assure 
their  utility  unless  comparable  information  has  been  sought 
in  comparable  ways  in  comparetble  forms  from  comparable 
sources.    The  failxire  to  create  comparable  information 
subverts  all  efforts  accurately  to  assess  differences  and 
chemges  in  educational  circumstances  between  places  and  over 
time  and  thereby  weakens  or  nullifies  policies  built  upon 
them. 

The  third  principle  is  that  of  potential  utility. 
Educational  data  should  be  collected  even  in  the  absence  of 
contemporary  or  immediate  needs  in  policy-making,  and  they 
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should  be  collected  in  such  form  rhat  they  can  be  re- 
formulated for  changing  uses.    Failure  to  collect  data  that 
may  seem  superfluous  for  inunediate  presentation  can  reduce 
the    effectiveness  of  future  policies  by  inhibiting  their 
substantiation  and  the  evaluation  of  their  historical 
significance • 

Related  to  potential  utility  is  a  fourth  principle, 
that  of  history*    Too  often  ignored  but  essential  to  the 
evaluation  of  the  meaning  of  any  changes  over  time,  historical 
statistics  provide  the  context  for  the  interpretation  of 
long-term  change •    Without  historical  statistics,  all 
claims  about  trends,  the  significance  of  data,  and  tho 
solutions  to. problems  are  suspect. 

Fifth  and  final  is  the  modest,  but  essential,  principle 
of  ease.     If  responses  to  requests  for  data  become  burdensome/ 
or  if  data,  once  collected,  camnot  be  easily  used  or 
assessed,  statistics  decline  in  appeal.    Therefore,  data 
reporting  must  be  made  simple  for  those  from  whom  it  is 
solicited,  and  data  samples  should  be  collected  in  place  of 
statistics  on  a  complete  universe  whenever  possible, 
Relatedly,  data  that  lend  them/ elves  readily  to  scholarly 
cuialysis  —  even  to  such  basic  and  simple  uses  as 
correlations  ~  should  be  collected  so  that  the  function  of 
NCES  can  remain  primarily  that  of  data  collection  rather 
than  analysis,  which  should  be  carried  out  by  others. 
Furthermore,  data  should  be  presented  in  such  a  way  that 
local  reporting  units,  be  tbey  individual  schools  or  entire 
school  districts,  can  assess  their  relative  positions  in 
comparison  with  averages  for  similar  reporting  units. 

Taken  together,  these  principles,  if  applied,  will 
help  ensure  the  integrity  and  applicability  of  the  statistical 
information  upon  which  we  must  in  part  base  all  general 
educational  policies.    Yet  they  will  not  at  all  times  be  of 
equal  moment,  .  Occasionally,  circumstar.wes  may  require 
emphasis  upon  a  single  one  in  order  to  increase  confidence 
in  the  strength  of  all  data.     In  my  view,  now  is  such  a 
time.    What  requires  immediate  attention,  in  order  to  secure 
the  utility  of  what  information,  however  accurate,  we  now 
have,  is  the  comparability  of  educational  data.    And  the 
Department  of  Education  must  take  the  I'^.ad  in  this  effort. 

For  many  reasons,  the  American  pxiblic  now  seeks  to  be 
assured  of  improvements  in  education  at  all  levels,  especially 
in  the  primary  and  secondary  schools.    And,  characteristically, 
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it  wants  information  that  compares  present  conditions  with 
those  of  the  recenr  past  and  conditions  in  one  jurisdiction 
with  those  in  others.    Yet  the  plain  fact  of  the  matter  is 
that  the  data  available  to  provide  such  comparisons  are 
embarrassingly  weak.    The  public  is  being  misled  by  their 
use.    And  policies  based  upon  them  may  therefore  be  without 
foundation  or  desired  effect.    For  these  reasons,  even 
before  attempts  are  made  to  improve  the  collection  of 
accurate  raw  data,  the  data  that  are  solicited  must  be 
collected  in  ways  that  allow  accurate  comparisons  of 
educational  conditions  among  jurisdictions  and  across  time. 
This  is  not  to  say  that  the  search  for  improved  accuracy 
should  not  proceed.    Rather ,  the  pviblic  as  well  as  policy- 
makers must  be  assured  that,  even  in  the  absence  of  reliable 
data,  the  nature,  direction,  and  extent  of  change  in  American 
education  is  accurately  represented  by  the  data  that  we  do 
have.    That  cannot  be  done  now. 

Moreover,  the  data  that  are  gathered  and  published  must 
be  consistent  over  time.    Too  often,  the  existing  data  series 
are  presented  differently,  due  both  to  altered  data-gathering 
methods  and  chamged  survey  questions,  from  one  year  to  the 
next.    This  renders  virtually  nugatory  all  attempts  to 
evaluate  changes  in  educational  conditions. 

How  should  the  endeavor  to  improve  the  comparability  of 
data  be  undertaken?    Despite  the  sensitivity,  as  misplaced 
as  it  often  is,  toward  the  centralization  of  educational 
policy,  the  attempt  to  collect  comparable  data  should  be 
led  by  a  national  agency  or  organization,  if  not  by  the 
Department  of  Education  then  tinder  the  auspices  of  the 
Council  of  Chief  State  School  Officers.    In  any  case,  both 
must  act  in  concert  with  state  officials  to  standardize 
data  collection  and  presentation. 

One  problem  facing  the  Depaxcment  and  MCES  is  the  use 
of  proxies  for  collecting  data,  as  a  result  of  which  the 
government's  need  for  information  depends  upon  the  needs  of 
other  organizations  and  agencies  and  often  falls  victim  to 
them.    This  is  most  visible  in  data  from  sample  surveys, 
often  xindertaken  at  a  third  remove  —  that  is,  at  the  behest 
of  clients  of  reporting  organizations.    If  adequate  and 
consistent  proxy  suirveys  and  data  cannot  be  secured,  then 
the  Department  must  try  to  secure  them  directly  or  by 
contract . 

Additions  to,  and  changes  in,  existing  data  series  will 
not  be  of  much  use  in  my  estimation  without  speedy  attention 


to  these  general  and  encompassing  obstacles  that  now  stand 
in  the  way  of  sound  data  collection.    Nevertheless,  some 
more  specific  matters  also  require  tending  to  if  the 
Department's  data  series  are  to  be  made  more  useful • 
Omissions  in  the  data,  especially  those  concerning  the 
quality  of  primary  and  secondary  schooling,  myst  be  filled. 
Although  all  efforts  to  measure  the  quality  of  education 
must  end  in  approximations,  they  must  nonetheless  be  made 
and  the  glaring  lacunae  in  existing  data  closed. 

For  instance,  despite  the  intensive  debate  regarding 
the  preparation  and  qualifications  of  school  teachers,  we 
have  no  adequate  current  or  long-term  information  to  that 
effect.    Data  series,  by  state,  about  teachers'  levels  of 
education  (bachelor,  master,  and  doctoral  degrees  and 
credit  hours  beyond  certification),  permanent  and  temporary 
certification,  the  ratio  of  those  teaching  with  and  without 
certification  in  their  field  of  instruction,  the  percentage 
of  those  who  have  switched  teaching  fields,  the  percentage 
of  those  teaching  subjects  in  which  they  were  not  initially 
trained,  student -teacher  ratios  by  fields,  the  results  of 
newly-instituted  competency  tests,  and  similar  matters 
sh9uld  be  maintained  and  presented  historically.  Similarly, 
we  should  have  measures  of    scores  on  the  College  Board 
and  other  advanced  placement  and  achievement  tests,  broken 
out  by  states  and  public  and  private  schools.    Efforts  to 
measure  changes  in  college  entrance  requirements  should  be 
endeavored  too,  as  well  as  changes  in  the  relative  proportion 
of  advanced  and  AP  courses  and  general  courses  and  in  the 
number  and  proportion  of  students  taJcing  each. 

In  many  cases,  data  are  unwisely  aggregated  or 
aggregated  in  forms  that  reduce  their  usefulness.  Despite 
jurisdictional  realities,  a  better  unit  for  comparison  of 
much  data  is  probably  the  standard  metropolitem  area  rather 
them  the  state,  at  least  for  urban  schools.  Analogously, 
data  regarding  public  and  private  schools  should  be  dis- 
tinguished.   Much  of  the  data  fail  to  reflect  the  dual 
system  of  American  education  at  all  levels;  and  even  those 
few  efforts  to  distinguish  between  different  kinds  of 
private  and  religious  schools  are  not  carried  out  con- 
sistently in  the  series  now  pxiblished. 

Discontinuities  in  students*  school  experiences  are 
not  adequately  assessed  either.    Measures  of  dropping  out, 
notoriously  weak  as  they  may  be,  fail  to  distinguish 


between  chosen  interruptions  in  schooling  ("stopping  out") 
and  involuntary  interruptions  (such  as  moving  from  one 
school  to  another) •    These  data  could  be  collected  via 
sample  surveys  and  with  the  assistance  of  the  Bureau  of 
the  Census.    In  fact,  one  measure  of  the  stability  of  schools 
might  be  a  simple  ratio  of  new  to  returning  students  per 
jurisdiction. 

Of  the  curricular  information  that  should  be  added 
to  existing  data  series,  that  concerning  the  state  of  art 
and  music  should  have  high  priority.    The  omission  of  these 
subjects  from  consideration  by  authors  of  the  recent  flood 
of  national  reports  on  schooling  was  egregious.    By  contrast, 
already  collected  data  on  so-called  remedial  coxirses  are 
probably  the  weakest  that  are  published,  given  the  wide 
differences  in  definitions  of  remediation  by  school  districts 
and  individual,  especially  private,  schools.    Such  data 
could  be  omitted. 

Finally,  some  attention  should  be  given  to  publishing 
revised  data  as  better  information  is  collected  or  errors 
in  previously  published  data  are  discovered  —  as,  for 
example,  the  Treasury  Department  routinely  does  with  its 
periodic  economic  statistics.    For  example,  it  is  exceedingly 
unlikely  that  the  percentage  of  18-19  year  olds  graduating 
from  high  school  rose  by  5.4  per  cent  between  1975  and  1976 
and  then  dropped  3.3  per  cent  the  next  year.    Chances  are 
that  the  data  for  1976  are  suspect.    Such  evident  abnormalities 
should  be  carefully  checked;  and  if  the  data  are  found  to  be 
erroneous,  they  should  be  revised  in  all  subsequent 
publications. 

In  all  of  these  modest  ways,  and  in  others  that  will 
be  proposed,  the  foundations  of  knowledge  about  American 
education  will  be  greatly  strengthened. 
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INTRODUCTION 


In  this  paper,  I  comment  on  the  tvo  categories  of  NCES  elementary- 
secondary  data  with  which  I  am  most  familiar  from  my  own  work:  data  on 
school  finance  and  data  on  teachers.    In  discussing  each,  I  review  current 
NCES  offerings  and  their  limitations,  Identify  additional  data  needed 
to  serve  policymaking  and  research,  and  suggest  modifications  (mainly 
expansions)  of  NCES  data  collection  efforts* 

The  two  data  categories  I  deal  with,  school  finance  and  teachers, 
may  seem  at  first  to  be  only  distantly  related  to  one  another,  but  the 
connection  between  the  two  becomes  more  apparent  when  one  thinks  of  teacher 
data  as  a  subset  of  data  on  educational  resources.    There  Is  a  logical 
chain  of  variables  running  from  money  to  resources  to  services  to  educational 
results,  and  the  two  categories  considered  here  correspond  to  adjacent 
links  in  that  sequence*    Information  on  school  finance  indicates  how 
money  for  education  is  raised  and  how  it  is  expended;  information  on 
resources  (specifically,  teachers)  indicates  what  money  buys  and  how 
the  inputs  into  schooling  are  used*    As  I  will  argue  below,  the  failure 
of  current  d&ta  to  illuminate  the  finance'-resource  connection  is  a  major 
shortcoming  of  the  existing  NCES  data  system*^ 

The  following  comments  are  limited  in  several  important  respects* 
First,  I  have  stopped  well  short  of  proposing  specific  data  system  designs, 
both  because  that  task  is  too  large  for  this  type  of  paper  and  because 
of  my  own  limited  expertise*    Second,  I  have  not  addressed  technical 
questions  of  data  quality  because  I  have  nothing  to  add  on  that  subject 

^I  would  have  preferred  to  look  at  resource  data  across  the  board  but 
did  not  have  time  to  undertake  that  task*    Bowever,  much  of  what  is  said 
here  about  teachers  applies  to  instructional  personnel  generally  and 
hence  to  the  most  important  resource  category* 


to  what  NCES  already  knows.    Third »  I  have  not  taken  budget  constraints 
Into  account  In  discussing  what  data  NCES  should  collect*    If  that  gives 
my  suggestions  an  air  of  unreality,  I  apologize,  but  I  thought  that  someone 
should  consider,  without  prior  restraints,  what  Information  an  advanced 
country  might  reasonably  want  to  gather  about  Its  own  educational  system. 

SCHOOL  FINANCE  DATA 

NCES  has  long  been  In  the  business  of  collecting  school  finance 
data  and  reporting  basic  finance  statistics  for  states  and,  at  times, 
for  local  school  districts •    These  data  have  often  been  used  for  making 
gross  fiscal  comparisons  (e.g.,  of  per  pupil  spending  among  states)  and 
charting  broad  trends  In  support  for  the  schools,  but  they  have  been 
of  little  use  for  addressing  the  central  "adequacy"  and  "equity"  Issues 
of  school  finance,  analyzing  resource  allocation  patterns,  or  relating 
funds  and  resources  to  educational  results.    My  main  purpose  In  this 
section  Is  to  explain  why  the  existing  finance  data  are  Inadequate  for 
such  purposes  and  to  suggest  what  It  will  take  to  make  them  more  useful. 

Current  NCES  Finance  Data 

The  NCES  currently  produces  what  might  fairly  be  described  as  skeletal 
Information  on  school  finance.    The  principal  data  collection  Instruments, 
the  Common  Cote  of  Data  (CCD)  State  Fiscal  Report  and  Public  School  District 
Finance  Report,  distinguish  among  revenues  from  local.  Intermediate, 
state,  and  federal  sources  and  among  outlays  for  Instruction,  support 
services,  and  ncnlnstructlonal  services.    They  also  break  out,  on  the 
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revenue  side,  receipts  from  property  taxes,  tuitions,  and  Intergovernmental 
transfers  and,  on  the  outlay  side,  spending  for  salaries,  employee  benefits, 
debt  service,  and  construction.    State-by-cnate  data  are  reported  In 
the  Condition  of  Education  and  Digest  of  Education  Statistics  (hereafter, 
"Condition''  and  "Digest respectively),  typically  with  lags  of  three 
to  four  years .2    Financial  data  for  selected  large  local  districts  have 
been  published  Irregularly  In  the  past,  but  the  l/test  such  data  to  appear 
In  the  Digest  are  for  the  1979-80  school  year .3    Although  district-level 
data  hrve  supposedly  been  collected  annually  In  the  CCD  surveys,  neither 
the  data  themselves  nor  any  findings  based  upon  them  (except  for  state 
totals)  have,  to  ny  knowledge,  been  published*    I  do  not  know  whether 
or  for  what  purpose  such  data  are  used  once  they  have  been  collected* 
In  particular,  I  note  that  there  are  no  NCES  publications  describing 
the  distributions  of  revenues  or  expenditures  among  local  school  districts, 
either  aatlonally  or  within  states,  even  though  distributional  statistics 
(especially  indicators  of  Intrastate  disparities)  have  long  been  the 
central  concerns  of  school  finance  policymakers  and  researchers* 

It  Is  also  notable  that  the  categories  used  by  NCES  to  collect  and 
report  state  and  loi  al  finance  data  are  now  less  detailed  than  In  earlier 
years*    Formerly,  distinctions  were  made  on  the  expenditure  side  among 
such  traditional  school  accounting  categories  as  Instruction,  administration, 
plant  operation  and  maintenance,  fixed  charges,  etc*    Now  there  appears 

2For  example,  the  Digest,  1983-8A,  presents  revenues  and  expenditures 
for  1980-81  (pp*  78-79),  and  the  Condition,  198A,  gives  expenditures 
and  revenues  for  1981-82  (the  latter,  for  som^  reason,  from  NEA  estimates 
rather  than  NCES*  own  sources)* 

^Digest,  1983-8A,  pp*  60-61.    The  Identical  1979-80  finance  data  also 
appeared  In  the  1982-83  edition* 
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to  be  only  the  three-way  CCD  breakout  Indicated  above*    "This  Is  only 
a  small  loss,  however,  since  as  I  vill  discuss  below,  the  expenditure 
information  of  greatest  interest  is,  and  always  has  been,  concealed  within 
the  overbroad  "instruction**  category. 

To  put  the  NCES  efforts  in  context,  one  must  also  take  into  account 
the  separate  system  of  school  finance  data  collection  and  reporting  operated 
by  the  Governments  Division  of  the  Census  Bureau*    The  annual  Census 
survey  (a  census  in  some  states  and  a  sample  survzy  in  others)  covers 
most  districts  in  the  U*S*    The  Bureau's  reports,  entitled  Finances  of 
Public  School  Systems,  present  expenditure  and  revenue  data  for  states 
and  for  individual  school  districts  of  over  15,000  enrollment.  They 
are  produced  with  a  time  lag  of  under  two  years  (i*e.,  the  1982-83  data 
have  appeared).    The  categories  used,  while  generally  no  more  detailed 
than  those  of  NCES,  reflect  certain  important  distinctions  not  made  in 
the  NCES  reports  (see  below). 

Data  Shortcomings  and  their  Consequences 

There  has  been  much  discussion  over  the  years  of  certain  technical 
problems  concerning  the  school  finance  data,  including  problems  of  coverage, 
definition,  and  data  comparability  (e.g.,  in  the  treatment  of  pensions)* 
These  issues  are  familiar  to  NCES  staff,  and  there  is  little  I  could 
add  that  would  be  helpful.    I  focus  instead  on  what  I  believe  are  some 
broader  issues  bearing  on  the  usefulness  of  the  finance  data  for  research 
and  policymaking.    I  consider,  first,  the  lack  of  sufficient  expenditure 
detail  to  make  the  connection  between  finances  and  resources;  second, 
the  absence  of  distributional  statistics  pertinent  to  major  school  finance 


concerns;  third »  gaps  In  the  Information  on  school  revenue;  and  finally, 
the  problem  of  Instability  over  time  In  school  finance  data  collection* 

The  Lack  of  Expenditure  Detail  and  the  Disjunction 
between  Expenditure  and  Resource  Information 

The  education  expenditure  data  currently  reported  by  NCES  are  service- 
able »  at  best  9  for  making  gross  fiscal  comparisons  among  states  and  examining 
broad  trends  In  public  support  for  the  schools*    Even  In  those  applications 
they  can  be  misleading,  because  differences  In  dollar  outlays  among  states 
and  over  time  do  not  necessarily  correspond  to  differences  In  educational 

resources*    But  more  li^iportanty  they  are  not  suitable  for  other  purposes 

♦ 

to  which  potential  users  would  like  to  apply  a  school  finance  (or  finance/- 
resource)  data  base*    Setting  aside  the  distributional  Issues  for  separate 
consideration »  these  applications  Include  such  things  as  the  following: 

o  Analyses  of  what  education  mv^ney  Is  used  for  (l*e*9 
what  money  buys)  In  different  states  and  IZAs^ 

o  Comparisons  of  amounts  spent  and  prices  paid  for 
particular  kinds  of  resources  (especially  teachers 
and  other  Instructional  staff)  In  different  places 
or  at  different  times » 

o  Analyses  of  amounts  expended  for  different  levels  or 
types  of  Instruction »  or  on  behalf  of  different  cate- 
gories of  pupils » 

o  Research  on  relationships  between  school  spending  and 
educational  services  and  outcomes* 


Two  reasons  for  the  limited  usefulness  of  current  data  are  that 
expeni'lture  data  are  not  collected  In  sufficient  detail  to  be  connected 
with  resource  categories »  and  expenditure  and  resource  categories  are 
not  coordinated*    Consequently »  liiformatlon  on  dollar  outlays  cannot 
be  linked  to  anything  real*    Most  expenditures  of  direct  educational 
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Interest,  In  fact,  are  contained  within  the  single,  overbroad,  traditional 
category,  "instruction,"  which  is  not  decomposed  either  by  type  of  resource 
or  by  the  various  pui. poses  for  which  instructional  resources  are  used. 
Other  costs  of  instructional  resources,  notably  fringe  bei^sfits,  are 
hidden  within  the  mysterious  category,  ''fixed  charges."    In  consequence, 
one  cannot  tell  how  much  of  a  state's  or  an  LEA's  education  budget  is 
expended  on  classroom  teachers,  as  opposed,  say,  to  administrators,  special- 
ists, or  instructional  materials;  nor  how  much  is  spent  for  staff  compen- 
sation, counting  nonsalary  as  well  as  salary  costs;  nor  what  is  spent 
in  high  schools,  as  compared  with  elementary  schools,  or  for  vocational, 
as  opposed  to  academic,  programs;  nor,  in  comparing  states,  whether  differ- 
ences in  instructional  outlays  per  pupil  are  due  to  differences  In  staffing 
ratios,  differences  in  salary  per  staff  member,  or  both.    Without  being  ( 
able  to  make  such  distinctions,  one  has  very  limited  ability  to  make  . 
sense  of  interjurisdictional  financial  comparisons  or  to  address  the 
issues  of  resource  and  financial  adequacy. 

There  is  little  doubt  about  what  is  needed  to  create  these  missing 
analytical  capabilities.    In  general,  the  expenditure  data  need  to  be 
disaggregated  and  rearranged  into  educationally  and  ecoi^omically  meaningful 
categories.    For  instance,  to  connect  finances  to  resource  allocation  (and, 
ultimately,  to  services  and  effectiveness),  it  would  be  necessary  to 
disaggregate  expenditures  (especially  but  not  exclusively  outlays  for 
"instruction*)  into  appropriate  resource,  or  "object,-  categories.  Speci- 
fically, I  envision  a  system  of  combined  expenditure  and  resource  accounts, 
in  which  instructional  outlays  are  explicitly  linked  to  numbers  of  instruc- 
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llonal  staff,  amounts  of  other  resources,  ^taff  compensation,  and  other 
prices  In  a  manner  something  like  the  following:^ 


Instruction 
Instructional  personnel 

Classroom  teachers:  (number)  x  (avg*  salary) 
Specialist  teachers:  (number)  x  (avg>  salar  ) 
Teaching  aides:  (number)     x     (avg>  salary) 

• • •  etc  • • • 
Instructional  materials: 
Total  Instnictlon: 


(outlay) 
(outlay) 
(outlay) 


(outlay) 
(outlay) 


Given  such  a  data  set  (especially  vlth  the  data  expressed  in  per 
pupil  form),  it  vould  be  immediately  apparent  whether  differences  in 
spending  levels  among  places  or  over  time  reflect  differences  in  r*al 
resources  or  differences  in  salaries  and  other  prices.    If  nothing  else, 
this  should  promote  more  meaningful  interstate  and  intertemporal  comparisons « 
But  going  beyond  mere  comparisons,  I  vould  expect  such  data  to  make  possible 
a  variety  of  analyses  of  resource  allocation  patterns  and  behavior  now 
feasible  only  vlth  ad  hoc  data  bases  from  selected  states*    One  vould 
be  able  to  ask,  for  example,  vhat  shares  of  the  incremental  education 
dollar  tend  to  go  for  more  teachers,  highe repaid  teachers,  administrators, 
etc*  and  how  those  shares  vary  among  school  districts  vith  different 
characteristics*    Thu8»  expansion  of  the  expenditure  data  along  the  lines 


^For  simplicity,  I  treat  personnel  cost  in  this  example  as  synonymous 
vith  salary,  vhereas  more  appropriately  it  should  be  measured  by  total 
compensation,  which  in  turn  should  be  decomposed  into  current  salary, 
deferred  compensation  (retirement  programs)  and  other  fringe  benefits* 
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Indicated  should  lead  to  an  Improved  understanding  of  what  money  buys 
and  how  the  Inputs  Into  schooling  are  likely  to  be  affected  by  changes 
In  finance* 

A  very  different  question  from  vhat  money  Is  spent  on  Is  what  It 
Is  spent  for — I.e.,  for  vhat  purposes  or  programs  or  on  whose  behalf* 
There  has  long  been  Interest,  for  example.  In  how  funds  and  resources 
are  distributed  betveen  the  elementary,  middle,  and  high  school  levels, 
among  programs  (e*g*,  academic  versus  vocational),  and  among  "target 
groups"  (handicapped,  disadvantaged,  limited-English  proficient),  but 
the  data  have  not  been  available  to  provide  answers*    In  this  case,  however. 
It  Is  not  so  easy  to  fault  NCES  for  falling  to  provide  relevant  breakdowns 
of  outlays  because,  except  for  the  relatively  straightforward  breakdown 
by  level  of  school.  It  Is  not  clear  that  valid  disaggregation  Is  feasible* 

The  problem,  basically.  Is  that  school  districts  do  not  maintain 
the  kinds  of  cost  accounting  systems  that  would  be  needed  to  attribute 
costs  to  particular  pupil  categories  or  programs*    Segregating  such  costs 
would  be  easy  If,  for  example,  disadvantaged  and  handicapped  pupils  were 
educated  separately  from  regtilar  pupils  and  vocational  pupils  separately 
from  academic  pupils,  but  such  Is  rarely  the  case.    Typically,  the  different 
types  of  pupils  attend  the  same  schools  and  many  of  the  same  classes, 
are  served  Jointly  by  at  least  some  of  the  same  Instructional  staff, 
and  share  the  same  facilities  and  support  services*    Under  such  conditions. 
It  would  take  very  detailed  time  and  cost  accounting  systems  to  allocate 
outlays  properly. 

Given  that  few  districts  operate  such  accounting  systems,  an  attempt 
by  NCES  to  collect  outlay  data  by  pupil  category  or  program  would  probably 
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do  more  harm  than  good.    Reporting  by  local  and  state  officials  would 
probably  be  based  more  on  the  availability  of  earmarked  state  or  federal 
funds  for  particular  programs  or  groups  than  on  actual  costs  Incurred. 
The  resulting  data  would  be  unlikely  to  re. resent  properly  either  the 
total  costs  or  the  "add-on"  costs  of  the  programs  In  question*    I  conclude , 
therefore,  that  whereas  disaggregation  by  level  of  school  is  feasible 
(because  costs  are  incurred  by  distinct  organizational  units),  disaggregation 
by  program  or  pupil  category  is  Impractical  at  this  time«  Acquiring 
the  ability  to  disaggregate  by  the  latter  categories  should  be  treated 
as  a  longer  term  goalt  to  which  NCES  methodology  development  resources 
night  reasonably  be  devoted.    Meanwhile,  disaggregation  by  level  ^s  worthwhile 
in  its  own  right  (e.g.,  so  that  data  on  high  school  resources~not  high 
^  school  and  elementary  resource  combined~can  be  Juxtaposed  to  data  on 

high  school  outcomes)  and  should  be  pursued  as  a  shorter-term  goal. 

The  Lack  of  Statistics  on  Distributions  of 
Spending  and  Revenue  within  States 

Unlike  aggregative  financial  data  for  states,  financial  data  for 

local  school  districts  are  not  meaningful  or  accessible  until  they  have 

been  analyzed  and  summarized  statistically*    Users  cannot  scan  local 

expenditure  and  revenue  data  for  thousands  of  districts  in  search  of 

patterns 9  as  they  can  the  data  for  50  states*    Nor  can  they  rearrange, 

manipulate 9  «:nd  summarize  the  district-level  data  to  suit  their  needs, 

unless  they  are  equipped  (and  funded)  for  large-scale  data  iinalyses* 

The  value  of  the  district-level  finance  data  to  most  users  depends,  therefore, 

on  how  extensively  and  appropriately  such  data  are  analyzed  and  summarized 

statistically  by  NCES  itself. 

c 
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Different  kinds  of  summaries  and  analyses  are  useful,  of  course, 
for  different  purposes*    NCES,  In  the  past,  nas  provided  certain  summary 
statistics  of  district-level  finances  (notably.  In  publications  entitled 
Statistics  of  Local  Public  School  Systems,  Finances) .    Foi^lg^tance , 
It  has  compared  levels  of  spending  among  size  strata  of  districts,  among 
ge6graphlcal  regions,  and  among  central  city,  suburban,  and  nonmetropolltan 
districts*    Such  analyses  have  not  recently  appeared,  hovever*  They 
are  moderately  useful,  and  it  would  be  helpful  If  they  vere  revived  or, 
preferably,  expanded  to  cover  additional  district  characteristics  and 
cross-classlf Icatlons • 

Far  more  Important,  however.  Is  that  NCES  has  always  studiously 
avoided  producing  the  statistics  wanted  most  by  scholars  and  policymakers 
Involved  In  school  finance,  namely,  statistics  on  the  distributions  of 
expenditures  and  revenues  among  school  districts  within  states.  Such 
statistics  (e.g..  Indicators  of  Intradlstrlct  Inequality  In  school  spending 
and  tax  rates),  though  well  within  NCES*  technical  capacity  to  prepare, 
have  been  considered  too  politically  sensitive  by  NCES  leadership.  Their 
publication  might  offend  some  state  education  .agencies  (presumably  those 
of  high-dlsparlty  states),  and  they  could  even  be  used  as  evidence  In 
Serrano-type  school  finance  lawsuits.    Thus,  NCES  has  feared  that  developing 
such  statistics^  or  even  facilitating  their  development  by  others  (e.g., 
by  making  available  edited,  "^user-friendly"  district-level  data  files), 
could  undercut  the  state-agency  cooperation  on  which  NCES  depends  for 
much  of  Its  access  to  state-local  data. 

The  NCES  position  regarding  distributional  statistics  was  brought 
out  most  clearly  In  the  well-known  (among  school  finance  specialists) 
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"Profiles"  episode  of  1979-80.    At  that  time,  federal  interest  in  school 
finance  equity  had  reached  a  peak,  and  NCES  had  been  directed  explicitly 
by  the  Congress  (P.L.  95-561,  Sec.  1201)  to  produce  a  set  of  "profiles 
of  state  school  finance  equalization,"  showing  the  extent  of  fiscal  dispar- 
ities and  deviations  from  fiscal  neutrality  liTeach  state.    This  profiles 
report  was  to  be  the  first  of  an  ongoing  biennial  series.    NCES  did  not 
vant  to  produce  such  a  document,  primarily,  as  I  understand  It,  for  the 
reason  alluded  to  above.    Its  avoidance  strategy  was  one  of  protracted 
technical  delay.    Numerous  outlines  and  drafts  of  a  profiles  report  vere 
prepared,  some  by  contractors  and  consultants  and  some  by  NCES  staff, 
all  to  be  sent  back  for  reworking  or  rejected  outright  by  Internal  review 
committees*    The  strategy  worked.    By  late  1980,  the  federal  Interest 
In  school  finance  equity  had  declined  precipitously,  and  NCES  was  able 
to  fulfill  Its  formal  obligation  by  sending  a  report  to  Congress  :>  while 
suppressing  Its  further  publication.    Needless  to  say,  nothing  has  been 
heard  of  since  of  the  permanent  biennial  series  of  profiles  reports;  nor 
has  anything  else  emerged  from  NCES  (despite  the  availability  of  the 
CCD  dlstrlct-*level  data)  on  patterns  of  school  financing  within  the  states. 

T^iis  history  raises  several  Issues.    First,  of  course,  there  Is 
the  specific  question  of  whether  NCES  should  abstain  from  producing  statistics 
pertinent  to  the  central  concerns  of  school  finance  (or,  for  that  matter, 
to  any  other  educational  concern)  because  such  publication  might  displease 
some  states*    To  gain  some  perspective  on  the  issue,  consider  what  the 
reaction  would  be  if  the  appropriate  federal  agencies  failed  to  produce 
data  on  infant  mortality,  crime  rates,  inadequate  housing,  poverty,  or 
for  that  matter,  the  educational  attainment  of  the  population  because 
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officials  in  the  low-ranking  states  might  be  upset.    It  is  unlikely » 
in  such  areas,  that  state  embarrassment,  displeasure,  or  even  the  implicit 
threat  of  future  noncooperation  would  be  deemed  acceptable  reasons  for 
delimiting  the  federal  government's  information  gathering  role*  The 
same,  in  my  view,  should  be  true  in  education  and,  in  particular,  in 
school  finance* 

There  is,  second,  the  broader  issue  of  NCES*  posture  vis-a-vis  the 
states*    Often,  NCES  has  gone  to  state  agencies  as  a  supplicant,  seeking 
approval  to  collect  even  data  that  (a)  bear  directly  on  matters  of  national 
concern  or  (b>  are  needed  to  produce  a  coherent  picture  of  the  nation's 
education  system*    Although  I  cannot  prove  it,  I  believe  that  the  sparsity 
of  NCES  data  on  finance,  teachers,  and  other  aspects  of  education  is 
due  in  considerable  part  to  this  excessive  diffidence*    Whatever  the 
merits,  or  Imperatives,  of  a  supplicant  posture  may  have  been  in  the 
past,  there  is  now  good  reason  to  reconsider*    A  conservative  administration 
has  chosen  to  disseminate,  for  the  first  time,  state-by-state  comparative 
data  on  pupil  performance,  despite  the  unhappiness  this  doubtless  causes 
states  at  the  bottom  of  the  performance  ladder.    In  the  arei  of  finance 
and  elsewhere,  NCES  might  well  profit  by  that  example. 

Third,  there  is  an  issue  of  less  social  significance  but  considerable 
Importance  to  the  future  role  of  NCES,  namely,  how  far  the  agency  should 
generally  be  expected  to  go  in  analyzing,  as  opposed  to  collecting  and 
comnillng,  education  data.    Current  NCES  practice  in  that  regard  is  very 
uneven.    For  instance,  the  agency  has  sponsored  many  analyses  of  its 
longitudinal  survey  data  (the  National  Longitudinal  Survey  and  High  School 
and  Beyond),  even  extending  to  the  development  of  sophisticated  behavioral 
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models,  but  has  not  supported  even  rudimentary  analyses  of  the  school 
finance  data*    I  cannot  offer  a  general  recommendation  regarding  the 
appropriate  limits  on  the  analytical  role.    The  answer  obviously  depends ^ 
among  other  things,  on  the  agency* 3  mission  In  a  reorganized  Office  of 
Educational  Research  and  Improvement*    It  seems  to  me,  however,  that 
there  Is  one  valid  threshold  criterion:  NCES  should  be  expected  to  undertake 
enough  descriptive  (as  opposed  to  Inferential)  statistical  analysis  to 
present  meaningful  syntheses  and  analyses  of  patterns  In  Its  major  publica- 
tions*   This  has  not  been  done  In  either  of  the  two  areas  covered  by 
this  paper. 

Deficiencies  In  NCES  Revenue  Data 

^  Published  NCES  data  oa  public  school  revenue  are  useful  mainly  for 

making  Interstate  comparisons  and  examining  broad  trends  In  revenue  levels 
and  shares  of  revenue  from  federal,  state,  and  local  sources.    They  are 
of  little  usv*  for  any  further  analysis  of  revenue  sources  or  revenue-raising 
Instruments.    I  suggest  here  three  steps  that  would  Increase  substantially 
the  ufi::!fulness  of  the  revenue  Information:  elaboration  of  the  revenue 
categories,  production  of  data  on  revenue  bastfa,  and  compilation  of  nonsta- 
tlstlcal,  descriptive  data  on  state- local  school  revenue  systems. 

Revenue  Categories.    The  three-way  classification  of  revenue  by 
federal,  state,  and  local  sources  Is  useful  as  far  as  It  goes,  but  It 
conceals  some  important,  policy-relevant  Information  about  the  forms 
and  channels  through  vtch  revenue  Is  obtained.    The  following  changes 
In  revenue  categories  would  provide  a  more  accurate  and  complete  picture. 
First,  revenue  from  local  sources  should  be  decomposed  Into  tax  revenue 

^  (distinguishing  between  property  taxes  and  other  taxes),  current  charges 


ERIC  27 


or  user  fees  (mainly  tuitions),  contributions  from  parent  governments, 
and  "other  revenue***^    The  distinction  between  taxes  raised  by  ir.dependent 
local  districts  and  the  contributions,  or  appropriations,  that  dependent 
districts  receive  from  their  parent  c^^mtles,  municipalities,  or  townships 
Is  especially  important  (and  has  long  been  recognized  In  the  Census  Bureau's 
Finances  of  Public  School  Systems)*    Second,  research  on  school  finance 
systems  and  school  finance  equity  would  be  aided  If  distinctions  were 
made  between  general,  or  unrestricted,  state  aid  to  local  districts  and 
categorical,  or  restricted,  aid  (the  latter  Including  aid  earmarked  for 
particular  programs,  beneficiaries,  or  objects  of  expenditure).    Ic  would 
also  be  helpful  to  arrange  the  data  on  state  and  federal  aid  In  a  manner 
that  brings  together  both  federal  and  state  support  for  closely  related 
special  programs*    Third,  a  distinction  should  be  made  between  direct 
federal  education  aid  to  local  agencies  and  aid  that  Is  "passed  through," 
and  often  redistributed  by,  the  states  (this  distinction  Is  standard 
In  the  Census  publications). 

Revenue  Bases  and  Tax  Rates*    The  relationships  among  revenues, 
revenue  bases,  and  rates  of  taxation  for  schools  (effort)  are  Important 
questions  In  school  finance,  but  NCES  does  not  provide  data  on  bases 
or  rates*    Thus,  one  cannot  use  NCES  data  to  determine  how  variations 
In  spending  or  tax  rates  among  districts  are  Influenced  by  *  arlatlons 
In  local  tax  bases  or,  from  the  equity  standpoint,  to  determine  the  degree 
to  which  school  spending  Is  a  function  of  local  wealth.    During  the  latp 

5some  of  the  Items  mentioned,  Including  receipts  from  property  taxes  and 
tuitions,  are  already  Included  as  ^'special  exhibits"  In  the  CCD  surveys 
(according  to  NCES,  "The  Elementary/Secondary  Education  Data  Acquisition 
Program,"  an  unpublished  summary  description  of  NCES  elementary-secondary 
data  acquisition  systems). 
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1970 '8,  NCES  did  attempt  to  produce  data  on  equalized  property  tax  bases 
by  district,  but  the  effort  was  beset  by  technical  difficulties  and  has 
not  been  repeated.    The  technical  difficulties  are  indeed  substantial, 
since  each  state  has  its  own  methods  of  defining  and  measuring  the  tax 
base,  and  it  would  be  undesirable  to  publish  a  national  set  of  tax  base 
data  before  the  main  problems  of  comparability  are  overcome*    In  the 
interim,  however,  NCES  could  provide  a  useful  service  by  reporting  relative 
local  tax  bases  and  tax  rates,  using  the  official  definitions  of  each 
state*    Although  this  would  not  allow  interstate  comparisons  of  wealth, 
it  would  support  analyses  of  intrastate  relationships  between  spending 
and  wealth  and  comparisons  of  the  findings  from  such  analyses  among  states* 
Thus,  the  ability  to  analyze  school  finance  systems  could  be  enhanced 
significantly  at  very  little  cost  to  NCES* 

In  the  longer  run,  NCES  could  make  a  valuable  contribution  to  school 
finance  research  by  producing  not  only  comparable  data  on  local  wealth 
but  also  data  on  a  broader  range  of  local  economic  variables*    The  mapping 
of  decennial  Census  data  by  school  district  is  important  in  this  regard 
because  it  provides  information  on  income  and  poverty  in  each  district 
and  on  many  related  demographic  characteristics*    Selected  Census  data 
items  should  be  merged  with  NCES*  school  finance  data  and  made  available 
as  a  user  file*    With  such  a  data  set,  it  would  be  possible  to  link  fiscal 
and  resource  variables  to  multiple  district  attributes  and  to  address 
a  variety  of  concerns  about  how  different  communities  finance  their  schools 

Descriptive  Information  on  Revenue  Systems*    Although  NCES  is  a 
statistical  agency,  it  is  well  within  its  charter  to  collect  and  compile 
the  nonstatistical,  descriptive  information  needed  to  make  sense  of  its 


numerical  data.    In  the  area  of  school  revenue,  two  bodies  of  such  descriptive 
Information  ar<r  Important:  descriptions  of  state  aid  mechanisms  and  formulas 
and  descriptions  of  each  state's  legal  framework  governing  the  raising 


of  local  school  revenue •    Neither  type  of  Information  Is  now  provided 
by  NCES.' 

Over  the  years,  some  Infoncatlon  on  these  matters  has  been  produced 
by  other  offices  of  the  Education  Department •  . Specifically,  a  series 
of  volumes  edited  by  Esther  Tron  and  published  irregularly  by  the  Department 
provided  state-by-state  descriptions  of  school  finance  systems,  and  materials 
published  by  the  Education  Commission  of  the  States  (ECS),  under  sponsorship 
of  NIE,  provided  tabular  summaries  of  system  characteristics For  various 
reasons,  however,  neither  effort  has  filled  the  requirement  for  comprehensive, 
consistent,  and  timely  descriptions  of  how  each  state  raises  Its  public 
education  funds* 

It  seems  reasonable  thct  HCES,  as  the  Information-gathering  arm 
of  the  Department,  should  take  on  the  responsibility  for  maintaining 
a  continually  updated  file  of  such  Information.    Specifically,  I  suggest 
that  NCES  should  determine  and  publish  on  a  regular  annual  basis  the 
method  used  by  each  state  to  fund  Its  schools  (Including  full  mathematical 
details  of  the  formulas)  and  the  rules  under  which  each  state's  LEAs 
are  permitted  to  raise  revenue  (I.e.,  taxing  authority,  definitions  of 
tax  bases,  fiscal  constraints,  referendum  requirements,  etc.).  With 
that  Information  In  hand,  aiialysts  and  policymakers  would  be  much  better 


•i;;c  most  recent  of  the  Tron  compendia  Is  Public  School  Finance  Programs, 
1978-79,  U.S.  Government  Printing  Office,  Washington,  D.C.,  1980.  The 
ECS  tabulations  are  published  as  a  series  of  wall  charts,  entitled  School 
Finance  at  a  Glance,  the  most  recent  of  which  is  for  1983-84. 
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situated  to  Interpret  and  use  the  Improved  and  expanded  financial  statistics 
called  for  above* 

Stability  Over  Time 

Apart  from  any  deficiencies  of  content,  an  NCES  practice  that  has 
detracted  from  the  value  of  the  school  finance  data  Is  allowing  the  data 
production  effort  to  fluctuate  from  year  to  year  In  response  to  political 
currents*    Most  recently,  vhen  federal  Interest  In  Issues  of  school  finance 
adequacy  and  equity  plunged  tovard  zero  In  1980-81],  NCES  cut  back  Its 
school  finance  effort,  reducing  the  coverage  and  detail  of  Its  surveys 
as  well  as  Its  data  processing  and  publication  activity. 

This  Is  short-sighted  behavior.    Although  the  federal  demand  for 
school  finance  studies  Is  now  nil  (there  does  remain,  however,  substantial 
state- level  Interest  In  school  finance  adequacy,  equity,  and  reform), 
experience  Indicates  that  Interest  In  such  topics  Is  cyclical*    The  surge 
of  Interest  that  led  to  the  aforementioned  Profiles  requirement  and  a 
Congresslonally  mandated  school  finance  study  In  1979-80  was  preceded 
by  another  such  surge  In  1971  (the  President's  Commission  on  School  Finance)* 
It  Is  safe  to  say  that  Interest  In  the  topic  will  rise  again  In  the  future* 
When  It  does,  NCES  will  find  Itself  with  (a)  large  holes  In  the  historical 
data  base,  due  to  failure  to  sustain  Its  basic  surveys,  (b)  antiquated 
data  systems,  due  to  lack  of  development  effort,  and  (c)  no  capability 
to  generate  new  data  without  a  substantial  time  lag* 

This  on-agaln,  off-agaln  behavior  makes  little  sense  with  respect 
to  an  area  as  fundamental  to  policymaking  as  school  finance*    The  continuity 
of  the  data  base  Is  as  Important  a  determinant  of  Its  usefulness  as  Is 
data  quality.    I  recommend  that  stable,  annual  collection  and  publication 
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of  financial  data  (preferably  with  a  much-reduced  time  lag)  be  adopted 
as  an  agency  norm  under  the  new  ten-year  data  improvement  plan. 


DATA  ON  TEACHERS 


The  recent  upsurge  of  liiterest  In  teacher  quality,  teacher  compensation, 
and  teacher  supply  and  demand  has  drawn  attention  to  an  area  In  which 
NCES*  efforts  are  particularly  weak:  the  production  of  data  on  teachers 
and  teaching*    Current  NCES  data  on  these  subjects  do  not  suffice  even 
to  provide  general  background  Information  pertinent  to  policy  concerns > 
much  less  to  support  research  on  problems  and  possible  solutions.  Moreover, 
although  demands  for  Information  on  teachers  are  now  unusually  Intense, 
they  cannot  be  characterized  as  unanticipated  or  ""new*"    Questions  of 
teacher  supply  and  demand,  for  example,  have  concerned  policymakers  through 
multiple  cycles  of  "shortage"  and  "surplus;"  misgivings  about  teacher 
quality  are  perennial;  and  the  adequacy  and  form  of  teacher  compensation 
are  matters  of  continuing  public  and  professional  Interest,  quite  apart 
from  the  current  fascination  with  career  ladders  and  merit  pay*  Thus, 
the  point  In  faulting  NCES  for  the  paucity  of  Its  teacher  data  Is  not 
that  It  has  responded  slowly  to  the  Issue  of  the  moment  but  that  It  has 
neglected  an  area  of  long-*term  policy  concern* 


NCES  today  Is  able  to  tell  us  little  more  about  American  teachers 
than  how  many  there  are*    The  CCD  surveys  obtain  annual  data  on  numbers 
of  full-time  equivalent  elementary  and  secondary  teachers  (and  other 


Current  NCES  Data  on  Teachers 
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employees)  by  state  and  LEA*    The  state-level  data  are  reported  In  the 
Condition  and  Digest;  the  LEA- level  data  go  unpublished  and,  apparently, 
unanalyzed  (see  belov)*    NCES  collects  no  Information  on  the  composition 
and  characteristics  of  state  or  local  teaching  forces,  nor  on  assignments 
or  working  conditions  of  teachers,  nor  on  salaries  or  other  aspects  of 
compensation.    The  only  data  on  teacher  salaries  now  published  by  NCES 
are  estimates  of  average  salary  by  state  reprinted  from  publications 
of  the  National  E^^ucatlon  Association .7    The  occasional  and  fragmentary 
data  on  teacher  characteristics  and  assignments  published  by  NCES  (only 
for  the  nation  as  a  vhole)  are  also  borrowed  from  NEA.^   No  Information 
whatsoever  Is  provided  by  NCES  (or  NEA)  on  variations  In  teacher  character- 
istics or  assignments  among  states  or  LEAs;  nor  on  aspects  of  compensation 
other  than  the  mean  teachers*  salary  In  each  state. 

Aware  of  these  Increasingly  conspicuous  gaps,  NCES  has  recently 
taken  tentative  steps  to  produce  teacher  data.    In  c  new  survey  (the 
data  from  which  are  now  being  processed),  teachers  In  a  nationally  represen- 
tative sample  of  schools  were  asked  to  report  on  their  teaching  experience, 
training,  assignments,  work  hours,  compensation,  and  certain  personal 
characteristics. 9    in  addition,  NCES  la  about  to  sponsor  an  effort  to 
design  a  new,  more  extensive  survey  of  characteristics  of  the  teaching 

7For  example,  the  Digest,  1983-84  reprints  data  on  average  salaries  of 
teachers  and  Instructional  staff from  National  Education  Association, 
Estimates  of  School  Statistics,  1982-83  (pp.  54-56). 

^For  example,  the  Digest.  1983-84  presents  findings  from  NEA  sample  surveys 
on  the  composition  of  U.S.  teachers  by  race,  sex,  highest  degree,  etc.; 
on  average  age  and  experience;  and  on  average  hours  and  days  taught, 
class  sizes,  and  salaries  (Table  43,  p*  51). 

^National  Center  for  Education  Statistics,  *'The  Elementary/Secondary  Education 
Data  Acquisition  Program.** 


ERLC 


25 


(' 


force.    I  understand,  however,  that  neither  the  just-completed  survey 
nor  the  projected  more  extensive  survey  Is  designed  to  produce  Interjuris- 
dictional comparative  data,  and  so,  unless  further  action  Is  taken,  most 
of  the  aforementioned  data  gaps  will  remain. 

NCES  also  conducts  more  specialized  surveys  aimed  at  responding 
to  concerns  about  teacher  supply  and  demand.    In  a  survey  of  "Teacher 
Demand  and  Shortage,"  LEAs  and  other  educational  Institutions  are  asked 
to  report  on  teaching  positions,  vacancies,  nev  hires,  certification 
status  of  teachers,  and  teacher  assignments  but  not  on  teacher  character- 
istics or  compensation.    As  I  will  explain  below,  this  survey  Is  flawed 
not  only  because  key  Items  are  missing  but  also  because  It  Is  not  based 
on  economically  meaningful  definitions  of  "shortage"  or  "demand."  Some 
Information  on  newly  hired  teachers  and  their  characteristics.  Including  ( 
salary  information,'  Is  also  obtained  from  a  triennial  survey  of  recent 
college  graduates.    Neither  of  these  surveys  provides  interjurisdictional 
comparative  data,  however,  or  brings  together  the  multiple  types  of  data 
needed  for  policy  analyses.    Thus,  both  are  useful  only  for  very  limited 
purposes. 

Issues  and  Information  Needs 

To  show  why  the  aforementioned  gaps  in  NCES  teacher  data  are  troubling 
and  what  types  of  additional  data  are  required,  I  now  consider  some  current 
and  perennial  policy  concerns  and  research  questions  pertaining  to  teachers 
and  the  types  of  information  needed  to  address  them.    Specifically,  I 
comment  on  three  topics  of  current  concern:  teacher  quality,  teacher 
compensation,  and  teacher  demand  and  supply. 
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Teacher  Quality 

Even  before  the  reports  of  the  Commission  on  Excellence  and  ot^er 
reform  commissions  began  to  appear  In  1983,  teacher  quality  was  a  major 
concern  of  ed*Jcators  and  policymakers,  and  now  it  has  become  one  of  the 
central  feel  of  efforts  to  Improve  the  schools*    According  to  the  reformers, 
low  teacher  quality  Is  at  the  heart  of  our  educational  problems,  and 
drastic  changes  In  teacher  compensation,  certification,  and  training 
are  called  for.    However,  little  Is  known  about  even  the  most  basic  quality- 
related  attributes  of  the  teaching  force  or  about  the  relationships  of 
teacher  quality  to  other  factors,  and  the  paucity  of  NCES  data  plays 
a  role  In  preserving  this  Ignorance. 

Among  the  Issues  potentially  lllumlnable  by  better  data  are  how 
^  the  teaching  force  Is  and  has  been  changing  with  respect  to  certain  quality- 

related  attributes;  how  quality-related  characteristics  of  teachers  vary 
among  states,  school  districts,  and  schools;  how  such  characteristics 
relate  to  teacher  compensation,  other  conditions  of  teaching,  and  the 
state  of  the  teacher  market;  whether  teachers  with  different  characteristics 
tend  to  be  assigned  to  different  types  of  scho.ols  and  pupils;  and  how 
teacher  attributes  relate  to  pupil  achievement  and  other  measures  of 
educational  outcome*    Without  good,  disaggregated  data  on  teacher  character- 
istics and  assignments,  one  can  do  little  more  than  speculate  about  such 
concerns . 

NCES  cannot  be  faulted  for  falling  to  provide  data  on  teacher  q  lallty 
per  se,  since  there  Is  little  agreement  on  how  "quality"  can  or  should 
be  measured.    On  the  other  hand,  there  are  many  teacher  attributes,  arguably 
germane  to  the  quality  Issue,  that  are  not  only  feasible  but  relatively 
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easy  to  measure*    A  list  of  some  of  the  more  obvious  items  is  as  follows: 


o  Personal  characteristics:  age,  race,  sex,  languages 
spoken,  etc*, 

o  Educational  background:  attainment,  fields  of  study, 
degrees,  institutions  or  types  of  institutions  attended, 

o  Experience:  years  of  teaching,  assignments,  experience 
in  other  occupations, 

o  Career  pattern:  entry,  exit,  reentry;  rank,  promotion, 
plans  and  expectations, 

o  Assignment:  grade  level,  subject,  types  of  pupils,  type 
of  school,  special  programs, 

c  Work  load/working  conditions:  hours  per  day  (teaching, 
other),  days  per  year,  class  size,  pupil  load,  special 
pupils,  sttpport  staff,  nonteaching  responsibilities, 

o  Compensation:  salary,  retirement  and  other  fringe  benefits* 

I 

'  There  are  different  methods  of  obtaining  such  data*    The  possibilities 
include  sample  surveys  of  individual  teachers,  surveys  of  sample  districts 
(or  conceivably  all  districts),  and  surveys  of  states*    When  one  adds 
a  longitudinal  dimension,  the  possibilities  multiply*    As  usual,  the 
appropriateness  of  any  given  method  depends  on  the  purpose  for  which 
the  data  are  to  be  used.    I  discuss  below,  under  the  heading  ""possible 
data  collection  strategies,"  some  of  the  alternative  approaches  and  their 
uses*    For  the  moment,  I  note  only  the  following:  first,  that  the  approach 
toward  which  NCES  now  seems  to  be  leaning~collection  of  data  on  the 
characteristics  of  a  nationally  representative  sample  of  teachers^is 
suitable  for  only  a  limited  range  of  applications;  second,  that  work 
on  the  major  issues  of  teacher  quality  requires  interjurisdictional  com* 
parative  data  on  teacher  characteristics — something  that  seems  not  to 
be  contemplated  in  current  HCES  plans. 


Teacher  Compensation 

The  system  of  teacher  pay  Is  now  receiving  an  extraordinary  amount 
of  attention  because  of  recent  reform  commission  recommendations  in  favor 
of  merit  pay,  career  ladders,  and  other  forms  of  teacher  incentives. 
Some  states  are  already  acting  to  install  such  systems  and  others  are 
considering  the  possibility,  so  there  is  much  interest  in  assessing  existing 
and  alternative  salary  structures*    Even  without  this  special  interest, 
however,  teacher  compensation  is  a  matter  of  continual  concern  to  policy- 
makers.   Teachers*  salaries  are  the  largest  single  element  of  education 
cost,  and  the  level  of  teachers*  pay  has  long  been  assumed  to  be  a  major 

determinant  of  the  quality  of  the  teaching  force*    A  valuable  side  effect 

'  '     ~  • 

of  the  current  debate  over  teacher  incentives  has  been  to  make  clear 
how  little  organized  information  exists  oo  how  teachers  are  paid  in  different 
places  and  how  pay  systems  are  changing  and  on  the  consequences  thereof 
for  educational  costs,  the  make-up  of  the  teaching  force,  and  ultimately 
the  quality  of  teaching  and  educational  outcomes 

NCES  now  collects  no  information  of  its  own  on  teacher  compensation. 
Even  in  the  past,  before  abdicating  the  responsibility  and  leaving  it 
to  NEA,  it  collected  only  average  salary  data*.    But  average  salary  figures 
tell  very  little  about  how  states  or  districts  pay  their  teachers.  Districts 
can  have  identical  average  salaries  but  different  salary  schedules  and 
distributions  of  experience  and  training;  or,  districts  can  have  identical 

^('ihe  National  Education  Association  is  said  to  possess  a  large  computer 
file  of  individual  district  salary  schedules.    Such  information  could 
be  used  to  answer  a  variety  of  questions  about  how  teachers  are  paid 
in  different  types  of  school  districts  and  how  salaries  vary  with  teacher 
experience  and  training.    However,  the  NEA  apparently  does  not  use  its 
data  base  for  such  analytical  purposes  or,  if  it  does,  does  not  publish 
the  results. 
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salary  schedules  but  different  levels  of  average  pay.    It  is  presumably 
the  salary  schedule  rather  than  average  pay  that  determines  the  attractiveness 
of  a  district  to  teachers  and  hence  the  ability  of  a  district  to  attract 
quality  staff*    ThuSi  even  If  NCES  relnstltuted  collection  of  state  average 
salary  data,  that  vould  hardly  suffice  to  address  current  concerns  about 
teacher  quality  and  cost* 

To  see  vhat  kinds  of  data  night  be  vorth  collecting,  consider,  first, 
vhat  It  vould  take  to  provide  reasonably  complete  ansvers  to  the  questions, 
"hov  are  teachers  In  the  United  States  paid?**  and  "hov  does  the  compensation 
of  teachers  vary  among  school  systems  and  states?"    Going  beyond  undifferen- 
tiated salary  averages,  one  vould  vant  to  knov  hov  salaries  vary  In  relation  . 
to  teacher  characteristics.  Including  not  only  the  education  and  experience 
factors  on  vhlch  salaries  are  based  but  also  such  other  factors  as  age, 
sex,  race,  8ubject-*area  specialty,  and  grade-level  assignment*    It  Is 
more  Informative,  for  example,  to  make  Interjurisdictional  comparisons 
of  the  salaries  paid  teachers  vlth  standard  qualifications  (e*g*,  a  master's 
degree  and  five  years  of  experience)  than  of  overall  salary  averages* 
Moreover,  to  go  beyond  averages  In  another  respect,  one  vould  vant  to 
knov  hov  the  teachers  In  any  given  category  are  distributed  among  salary 
brackets*    For  Instance,  vhat  percentages  of  high  school  teachers,  or 
more  specifically,  of  high  school  mathematics  teachers,  earn  less  than 
$15,000,  $15,000  to  $20,000,  $20,000  to  $25,000,  and  so  forth*    In  addition, 
to  form  more  complete  pictures  of  teachers*  revards  and  teacher  personnel 
costs,  and  to  facilitate  Interjurisdictional  and  Interoccupatlonal  compar- 
isons, one  vould  vant  to  broaden  the  scope  of  data  collection  to  encompass 
retirement  contributions  and  other  fringe  benefits  as  veil  as  the  salary 
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component  of  compensation*    Flnallyi  to  describe  fully  how  teachers  are 
paid  requires  data  on  salary  schedules  as  well  as  on  levels  or  distributions 
of  pay — that  Is,  on  starting  salaries.  Increments  paid  for  additional 
units  of  training  and  experience,  and  any  Incentive  features  of  salary 
systems* 

As  to  the  appropriate  unit  of  analysis,  or  level  of  disaggregation, 
that  naturally  depends  on  how  the  data  are  to  be  used*    It  would  be  desirable, 
for  example.  In  conjunction  with  recent  Education  Department  efforts 
to  compare  educational  resources  and  outcomes  across  states,  to  produce 
8tate-by-8tate  salary  data^  broken  out  by  some  of  the  categories  suggested 
above*    For  other  purposes^  salary  data  by  type  of  district  (l«e*,  by 
district  size,  urbanlclty,  socioeconomic  composition,  etc*)  would  be 
more  appropriate;  and  for  more  detailed  analyses,  data  by  type  of  district 
within  each  state,  or  simply  data  for  Individual  districts,  would  be 
needed*    In  particular,  any  application  requiring  Information  on  salary 
schedules,  automatically  Implies  selection  of  the  Individual  district 
as  the  unit  of  analysis* 

Supply  and  Demand 

NCES  has  attempted,  as  mentioned  earlier,  to  respond  to  concerns 
about  teacher  supply  and  demand  by  conducting  Its  special  surveys  of 
"teacher  demand  and  shortage,**  but  there  are  several  respects  In  which 
these  efforts  need  to  be  strengthened*    The  main  shortcomings,  in  my 
view,  &re  (1)  the  lack  of  economic  underpinnings  and  the  consequent  omission 
of  categories  of  information  essential  to  an  analysis  of  demand  and  supply, 
and  (2)  inadequate  coverage  of  the  flow  of  persons  into  and  out  of  the 
teaching  force* 


The  absence  of  a  guiding  economic  conception  of  supply  and  demand 
Is  most  evident  from  the  failure  of  the  survey  designers  to  recognize 
that  supply,  demand,  surplus,  and  shortage  all  have  something  to  do  with 
prices  (salaries),  and  consequently  that  salary  Information  must  be  brought 
together  with  data  on  positions,  vacancies,  new  hires,  and  the  like.  If 
there  are  to  be  comparative  analyses  of  the  supply-demand  situations 
facing  different  districts  or  states,  differences  In  salaries  offered  by 
those  jurisdictions  are  likely  to  be  key  explanatory  factors.    Thus,  the 
collection  of  salary  Information  (which,  for  reasons  explained  above,  means 
considerably  more  than  Information  on  average  salaries)  should  be  Integrated 
with  collection  of  other  Information  bearing  on  supply-demand  Issues* 

Another  important  missing  element  Is  the  concept  of  a  teacher  market, 
or  market  area*    Where  many  districts  seek  to  hire  teachers  In  the  same 
market  (e.g..  In  a  major  metropolitan  area),  the  supply  of  teachers  to 
any  single  district  becomes  a  function  not  only  of  Its  own  salary  schedule, 
working  conditions,  and  other  attributes  but  also  of  the  characteristics 
of  the  competing  districts.    For  example,  $15,000  per  year  Is  a  high 
starting  salary  In  a  market  where  the  typical  offer  Is  $12,000  but  a 
low  one  where  It  la  $18,000*    To  contlbute  to  a  better  understanding 
of  teacher  markets,  therefore,  NCES  should  collect  data  not  only  on  the 
salaries  offered  by  each  jurisdiction  but  also  on  how  those  salaries 
compare  with  prevailing  salaries  In  the  particular  market  In  question. 

A  third  missing  Item,  related  to  the  two  already  mentioned.  Is  Infor- 
mation on  nonteachlng  salaries  In  the  various  teacher  markets.  Such 
Information  Is  germane  because  It  Is  relative  pay  that  affects  teacher 
supply.    A  given  teacher  pay  scale  may  be  highly  competitive  where  nonteaching 
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opportunities  i^t  college-educa       .workers  are  few  but  inadequate  where 
such  opportunities  are  plentiful*    Analyses  of  teacher  supply  and  demand, 
therefore,  require  data  not  only  on  teacher  salaries  but  on  salaries 
in  other  occupations  as  well.    This  does  not  mean  that  NCES  should  get 
into  the  business  of  collecting  data  on  wages  and  salaries  outside  education, 
but  it  does  suggest  that  such  data  should  be  obtained  by  NCES  (e.g.,  from 
the  Bureau  of  Labor  Statistics)  and  merged  with  information  on  teacher  pay. 

Turning  to  the  flow  of  teachers  into  and  out  of  the  system,  NCES 
seems  to  have  recognized  the  Importance  of  half  this  phenomenon,  the 
movement  of  new  entrants  into  teaching,  but  not  the  other  half,  the  outflow 
(turnover)  of  existing  teachers.    Moreover,  even  with  respect  to  the 
inflow,  more  information  needs  to  be  collected  to  understand  r^jpply-demand 
relationships  and,  especially,  the  changes  therein  due  to  changes  in 
teacher  standards  and  compensation.    Repor.       on  the  number  of  new  hires, 
as  in  the  VCES  "Demand  and  Shortage"  i^urvey,  is  not  enough.  Information 
should  be  obtained,  in  addition,  on  characteristics  of  the  newly  hired 
teachers,  where  they  come  from,  and  what  they  are  paid.    In  particular, 
it  is  through  the  hiring  process  that  new  state  incentive  pay  plans  and 
tightened  certification  requirements  are  likely  to  have  their  effects, 
if  any,  on  teacher  quality.    Consequently,  it  would  be  desirable  for 
NCES  to  monitor  the  characteristics  of  teaciers  newly  hired  during  the 
coming  years,  so  that  these  important  policy  changes  can  be  assessed. 

The  teacher  turnover/retention  process  is  as  important  as  the  entry 
process  l^i  shaping  the  character  of  the  teaching  force,  bjt  this  is  a 
process  about  which  little  is  known.    To  carry  out  a  comprehensive  analysis 
of  teacher  supply  and  demand,  one  would  need  information  on  which  types 
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of  teachers  depart  with  what  frequency  from  districts  with  different 
characteristics  and  different  pay  and  promotion  policies.    In  particular, 
it  is  now  becoming  important  to  observe  how  teacher  turnover  patti^rns 
are  affected  in  states  that  adopt  new  performance-based  pay  and  promotion 
plftns*    These  matters  are  not  covered,  to  my  knowledge,  by  current  or 
projected  NCES  data  collection  efforts-— an  important  gap  that  need:;  to 
be  filled. 

I  have  learned  recently,  in  the  course  of  an  international  comparative 
study  of  teachers*  salaries,  that  some  other  countries  are  able  to  report 
routinely  on  geographically  disaggregated  flows  of  personnel  into  and 
out  of  teaching.    This  would  mean,  for  the  United  States,  reporting  each 
year  on  (a)  the  number  of  persons  entering  teaching  in  each  state,  broken 
down  by  source  (l*e.,  new  college  graduates,  teachers  transfering  from  ^ 
ether  states,  persons  shifting  from  other  occupations,  etc.),  and  (b) 
the  number  of  persons  leaviag  teaching  in  each  state  due  to  death,  retirement, 
involuntary  termination,  transfers  to  other  states,  shifts  to  other  occupa- 
tions, and  departures  from  the  labor  force.    Such  a  flow  matrix  would 
provide  the  framework  for  a  wide  variety  of  supply«-detnand  studies*  It 
s^sems  well  worthwhile  at  least  to  investigate  the  cost  ac'^  feasibility 
of  creating  such  a  data  set* 


Possible  Data  Collection  Strategies 


If  NCES  does  become  involved  in  a  major  way  in  collection  of  data 


on  teachers,  it  will  have  to  make  some  strategic  decisions  at  the  outset. 


Among  these,  the  most  basic  concern  the  choices  of  units  of  analysis, 


respondents,  and  level  of  detail*    I  consider  here  some  of  the  diverse 
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purposes  for  which  teacher  data  might  be  wanted  and  the  degrees  to  which 
these  purposes  might  be  served  by  different  data  collection  modes* 

One  possible  objective,  clearly  of  current  Interest  to  the  Education 
Department,  Is  to  assemble  state-by-state  data  on  teachers  to  add  to 
the  comparative  displays  of  state  education  statistics  (the  famous  **wall 
charts'*)  distributed  by  the  Department  this  year  and  last.    The  only 
teacher  data  now  Included  are  pupil-teacher  ratios*    Other  ltem«  of  potential 
interest  Include  statewide  averages  of  teacher  experience,  training, 
and  other  characteristics  and  Indicators  of  the  level  of  teacher  compensation 
in  each  state,  such  as  the  salaries  paid,  on  average,  to  teachers  with 
specified  standard  characteristics.    Such  Information  could  be  obtained 
from  state  education  agencies  (which.  In  some  cases,  would  have  to  Institute 
new  data  collection  procedures  of  their  own  to  obtain  the  Information 
from  LEAs);  from  NCES  censuses  or,  possibly,  sample  surveys  of  Individual 
districts;  or,  in  part,  from  state-representative  sample  surveys  of  Individual 
teachers* 

Another  9  much  broader  objective  Is  to  construct  a  general  teacher 
data  base  that  can  be  used  to  support  a  variety  of  research  and  policy 
Inquiries.    Such  a  profile  should  Include  Information  on  teacher  character- 
istics, teacher  compensation »  and  the  conditions  of  teaching.  Disaggregation 
to  the  state  level  Is  the  minimum  required  for  such  a  file  to  be  at  all 
useful,  and  for  most  research  purposes  that  level  of  detail  would  not 
suffice.    For  Instance,  It  would  be  difficult  to  derive  valid  conclusions 
about  teacher  quality,  patterns  of  compensation,  or  relationships  between 
teacher  characteristics  and  outcomes  without  distinguishing,  at  lesst, 
among  urban,  suburban,  and  rural  districts;  districts  of  different  sizes; 
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and  districts  of  different  levels  of  Income  or  wealth.    For  In-depth 
analyses  In  any  of  these  areas,  Individual  district  data  would  be  required. 
Such  data  coul^^  be  obtained  through  state  agencies  or  from  LEAs  directly. 
The  choice  between  the  two  seems  to  hinge  on  (a)  the  apportionment  of 
the  data  collection  burden  and  (b)  the  trade-off  between  decentralization 
and  data  quality.    If  NCES  did  choose  the  direct  data  collection  strategy, 
It  would  seem  reasonable  to  take  advantage  of  the  tnaln  district-level 
data  collectl     mechanism  already  In  place  by  appending  a  detailed  set 
of  teacher-related  Items  to  the  Common  Core  of  Data. 

A  somewhat  more  specialized  research-oriented  objective  Is  to  assemble 
the  data  needed  to  address  teacher  supply  and  demand  Issues,  Including 
the  key  Issue  of  how  teacher  supply,  and  In  particular  Its  quality  dimension, 
responds  to  changes  In  compensation  and  other  market  conditions'^  Some 
aspects  of  these  Issues,  especially  questions  on  the  supply  side,  can 
be  addressed  through  sample  surveys  of  Individual  teachers  or  college 
graduates—provided,  however,  that  the  samples  are  drawn  not  merely  to 
be  nationally  representative  but  to  allow  comparisons  among  states  and 
types  of  districts*    Other  questions.  Including  many  on  the  demand  side, 
require  In-depth  data  from  samples  of  school  districts,  such  as  salary 
6Ch3dules  and  the  distributions  of  teachers  upon  them.    In  particular, 
an  analysis  of  the  flow  of  persons  Into  and  out  of  teaching  would  & 
to  require  district-level  data,  specifically  Incliidlng  detailed  Information 
on  those  entering  and  leaving  the  teaching  force. 

Finally,  a  narrower,  but  currently  high-prlorlty  objective  Is  to 
assemble  data  sets  suitable  for  evaluating  the  effects  of  the  major  changes 
In  teacher  pay  systems  and  certification  standards  now  being  Instituted 
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around  the  country.    This  world  probably  require  data  from  sample  districts 
in  states  establishing  the  new  systems  (i.e.,  merit  pay,  career  ladders, 
teacher  proficiency  examinations,  etc.),  with  special  emphasis  on  data 
concerning  newly  hired  teachers  and  teacher  turnover.    It  would  also 
require  collection  of  longitudinal  data  to  determine  the  effects  of  the 
policy  changes  over  time. 

This  list  by  no  means  exhausts  the  possibilities,  but  it  suffices 
to  make  several  points.    First,  geographically  disaggregated  teacher 
data  are  essential  for  research  and  policy  uses.    State-by-state  data 
will  serve  some  purposes,  but  for  many  research  applications,  district- 
level  data  will  be  required.    Second,  national  data,  and  hence  surveys 
based  only  on  nationally  representative  samples,  are  of  very  limited 
value*    They  provide  general  background  information  and  good  numbers 
to  use  in  speeches  but  contribute  little  to  understanding  how  the  teacher 
system  works.    Third,  whatever  the  unit  of  analysis  and  whatever  data 
collection  strategy  is  used,  it  is  important  that  data  on  all  the  relevant 
aspects  of  teaching  be  collected  together.    That  is,  data  on  teacher 
characteristics,  compensation,  working  conditions,  etc.  should  all  be 
collected  from  the  same  respondents  at  the  same  times,  so  that  relationships 
among  these  variables  can  be  explored.    Fourth  and  last,  a  nonsubstantive 
point:  different  potential  uses  of  teacher  data  lead  to  different  demands 
for  data,  and  it  is  not  readily  apparent  which  demands  should  have  prece- 
dence.   Therefore,  if  NCES  is  to  enter  the  field  of  teacher  data  collection 
in  a  serious  way  (whlcn  T  assume  it  must),  it  should  first  engage  in  a 
series  of  priority-setting  exercises  and  feasibility  studies  to  produce 
a  coherent  plan.    I  would  hope  that  such  a  review  could  begin  with  as 
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blank  a  slate  as  possible — i«e*)  without  preconceptions  regarding  the 
modes  of  data  collection  or  the  continuation  of  current  or  projected 
NCES  surveys  In  theli  present  forms. 


STATE'LOCAL  STATISTICAL  REPORTS 
AS  A  NATIONAL  (AND  NCES)  RESOURCE 


In  closing,  I  offer  one  additional  observation  that  cuts  across 
the  areas  of  school  finance  and  teachers  (and  probably  other  areas  of 
NCES  data  collection  as  veil).    I  have  long  believed  that  a  great  deal 
of  useful  data  for  educational  research  and  policy  studies  Is  produced 
by  scateu  (and,  In  some  cases,  by  local  districts)  but  that  the  lack 
of  an  organized,  central  collection  greatly  limits  Its  use.    I  suggest, 
therefore,  that  NCES  take  on  the  role  of  bringing  such  material  together 
In  a  vell-malntalned  central  repository. ' 

In  the  finance  area,  virtually  every  state  produces  an  annual  report 
on  the  finances  of  Its  school  districts •    These  reports  typically  present 
dl8trlct-by*dlstrlct  expenditure  and  revenue  data  In  substantial  detail 
and  also  cover  tax  bases  and  tax  rates*    The  level  of  detail  Is  often 
considerably  greater  than  tICES  could  be  expected  to  collect.    Even  though 
such  data  are  often  not  comparable  among  all  states,  there  are  some  cases 
In  vhlch  such  data  could  be  used  to  supplement  and  fill  gaps  In  NCES* 
own  data  bases,  and  there  are  many  more  cases  in  which  data  for  selected 
states  would  serve  the  purposes  of  research  and  policy  studies*    By  system- 
atically acquiring  the  annual  reports  of  all  the  states,  therefore,  NCES 
would  be  able  to  create  a  valuable,  multipurpose  analytical  tool.  In 
addition,  ""^^ch  useful  Information  could  be  extracted  from  the  budgetary 
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documents  and  financial  reports  of  local  districts,  selected  samples 

of  which  (e.g*i  from  large  districts)  should  be  Included  In  such  a  collection. 

In  t^e  teacher  area,  state  reports  are  more  variable  In  coverage 
and  format,  but  many  states  do  produce  reports  on  numbers  of  teachers 
(and  other  staff),  certain  8taff  characteristics,  and  staff  salaries 
by  district.    Some  of  these  reports  are  extremely  detailed.  California, 
for  Instance,  has  produced  for  many  years  an  annual  volume  providing 
not  only  the  full  salary  schedule  of  each  district  In  the  state  but  also 
the  number  of  teachers  In  every  cell  of  that  schedule.    In  some  cases, 
official  state  doctments  on  teachers  and  their  salaries  are  supplemented 
by  reports  produced  by  teachers*  unions,  containing  data  on  salaries, 
salary  schedules,  and  working  conditions  In  the  various  districts*  Like 
the  state- local  data  on  finances,  the  data  on  teachers.  If  brought  togethr, 
could  satisfy  a  vide  variety  of  data  needs.    In  addition,  during  the 
several  years  It  will  undoubtedly  take  NCES  to  produce  new  teacher  data 
of  Its  own,  compilations  of  selected  teacher  data  from  state  sources 
lulght  fill  some  of  the  currently  unmet  Information  needs. 

Establishing  a  central  data  repository  seems  a  natural  role  for 
the  national  education  statistics  agency.    The  availability  of  such  a 
resource  In-house  might  also  have  the  beneficial  side  effects  of  keeping 
NCES  staff  In  closer  touch  with  developments  In  the  states  and  providing 
means  of  cross-checking  NCES*  own  data*    At  least  a  prellml.iary  Inquiry 
seems  warranted  to  determine  what  data  are  regularly  produced  by  the 
states,  what  uses  they  might  serve,  and  how  much  It  would  cost  NCES  to 
develop  and  maintain  such  a  collection. 
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INTRODUCTION 

Key  to  answering  an  astonishing  number  of  policy  questions  Is 
understanding  two  relationships.    What  Is  the  relationship  between 
alternative  learning  opportunities  and  the  acquisition  of  skills? 
Specifically,  what  learning  opportunities— different  types  of  formal 
education,  leisure  activities,  and  work  experiences— are  interchangeable 
with  each  other  in  producing  skills,  and  under  what  conditions? 

And,  what  Is  the  relationship  between  the  nature  of  skills  and 
access  to  occupations?  How  does  the  array  of  skills  that  individuals 
possess  nap  onto  the  array  of  occupations,  as  evidenced  by  employment  in 
the  occupation?    How  do  tight  versus  loose  labor  markets  for  the 
occupation  change  the  mapping?    How  does  the  nature  of  the  employer's 
Job  structure  affect  the  mapping— for  example,  a  structure  with  fairly 
rigid,  narrowly-defined  job  categories  versus  one  with  broadly  defined 
categories?    How  does  the  "age"  of  the  occupation  (emerging  or 
established)  affect  the  mapping? 

The  National  Center  for  Education  Statistics  (NCES)  and  other 
agencies  nov  collect  data  that  allow  limited  analytic  progress  with 
these  questions.    However,  as  discussed  in  more  detail  later,  current 
longitudinal  data  bases  do  not  approach  their  potential  for  supporting 
research  into  these  issues. 

Answers  to  these  two  questions  can  illumine  a  surprising  range  of 
policy  issues.    I  discuss  three  examples  here:  shortages  and 
oversupplies  of  skills;  the  contribution  of  formal  corporate  training  to 
the  human  capital  of  the  labor  force;  and  theories  of  labor  markets  that 
underlie  federal  training  policies  for  disadvantaged  individuals  and 
dislocated  workers. 

ROLE  OF  INTERCHANGEABILITY  IN  EDUCATION  AND  EMPLOYMENT  POLICY 
Skill  Shortages  end  OversuppIlM 

Policy  concerns  about  oversupplies  or  shortages  of  particular 
skiUs—ecientists,  engineers,  or  public  school  teachers,  for  example- 
are  hardy  perennials.    These  concerns,  often  escalated  to  statements 
about  "crises,"  include  concerns  not  Just  about  shortages  or 
oversupplies  of  skills,  but  also  of  those  who  produce  them— for  example, 
of  mathematics  and  science  teachers  at  the  secondary  level  and  science 
and  engineering  faculties  at  the  post -secondary  level. 

These  "crises"  presume  that  shortages  or  oversupplies  matter. 
However,  we  lack  data  and  analyses  to  determine  if  and  when  they  matter, 
for  whom,  and  in  what  way.    For  example,  do  shortages  of  computer 
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science  teachers  at  the  post-*secondarv  level  affect  the  supply  of 
computer  skills  that  employers  need,  and,  if  so,  for  all  or  for 
specialized  skills  only?    Are  ther:»  alternative  sources  of  instruction? 
In  the  computer  case  we  know  that  students  in  all  of  the  highly 
quantitative  fields  gain  experience  with  computer-based  equipment  and 
software.    In  fact,  one  of  the  explanations  of  the  heterogeneous 
backgrourds  of  those  employed  in  computer  science  jobs^  is  that 
opport^nities  to  learn  the  skills  required  for  these  jobs  are  widely 
diffused  among  academic  departments. 

How  do  employers  and  individuals  trained  in  an  oversupplied  field 
respond  to  oversupplies ,  and  what  costs  do  these  responses  exact?  In 
other  words,  do  »v  need  to  worry  about  over  supplies?    Which  subgroups 
tend  to  absorb  the  costs  of  oversupplles?   Those  newly  trained  in  the 
occupation?    Those  approaching  retirement?    How  does  the  accommodation 
occur?    Under  what  conditions  do  employers  offer  and  individuals  accept 
lower  wages?    When  do  employers  ratchet  up  the  education  that  they 
require  of  new  hires  without  changing  the  skill  content  of  the  job?  Are 
individuals  who  accept  such  jobs  underemployed »  or  do  they  tend  to 
"upgrade"  thift  work  performed  to  match  their  skills?    How*  often  do 
trained  individuals  leave  their  field  of  training?  •  Do  they  tend  to 
enter  fields  that  use  some  part  of  their  past  educational  and  work 
experience?    Are  these  individuals  permanently  lost  to  the  field  in 
which  they  were  trained,  or  do  they  tend  to  migrr.te  back  into  it  as 
supply  and  demand  for  the  field  equilibrate? 

How  do  employers  respond  to  shortages  of  individuals  trained  in  a 
specific  field?    In  terms  of  educational  and  work  backgrounds,  how  wide 
a  net  do  employers  seem  wll  ling  to  cast  to  fill  positions?    How  low  in 
the  level  of  training  in  th^^  shortage  field  (e.g. ,  ratcheting  down  from 
an  M.S.  degree  to  an  B.S  degree)  do  employers  seem  willing  to  go?  What 
are  the  consequences  of  staffing  Jobs  with  less  advanced  or  less  germane 
training?    How  "tolerant"  are  different  occupations  of  variations  in 
skills,  i.e.,  how  wide  a  spread  of  skills  can  they  accommodate  before 
productivity  declines?    How  do  discrepancies  between  the  skills  required 
and  those  hired  become  resolved?  Do  occupants  of  Jobs  learn  the  skills 
required  or  do  they  transform  the  Job  to  fit  their  skills? 

A  study  of  how  employers  staffed  three  electronic  data  processing 
(EDP)  occupations  (computer  operators,  programmers,  and  systems 
analysts)  between  1965  and  1970  Illustrates  employer  responses  to 
shortages  in  an  emerging  occupation.^  The  authors  found  that  a  third  of 
the  1970  EDP  labor  force  had  been  employed  in  EDP  occupations  in  1965;  a 
third  had  entered  the  labor  force  since  1965;  and  a  third  had  worked  in 
non-EDP  occupations  in  1965.    The  majority  of  the  lateral  transfers  did 


^Table  B-8,  National  Science  Foundation,  Characteristics  of  Recent 
Science /Engineering  Graduates: 1982,  Report  No.  NSF84-318,  pp. 23-24,  U.S. 
Government  Printing  Office,  Washington,  D.C.,  1984. 

^Sheldon  Haber  and  Robert  Goldfarb.  "Labor  Market  Responses  for 
Com:uter  Occupations,"  Industrial  Relations,  17  (1),  53-63,  February. 
1978. 


42 

so 


not  come  from  disciplines  and  occupations  related  to  EDP  occupations: 
only  30.2  percent  of  these  transfers  had  been  engineers ,  mathematicians, 
life  and  physical  scientists,  engineering  and  science  technicians, 
accountants,  bookkeeper and  office  machine  operators.    Thus,  in  the 
EDP  case,  workers  in  unrelated  fields  constituted  an  important  part  of 
the  labor  response  to  rapidly  growing  demand. 

The  data  on  supply  sources  showed  that  entry  into  the  more  complex 
EDP  fields,  such  as  systems  analyst,  required  more  occupationally- 
germane  formal  or  on-the-job  training.    In  general,  however,  thc2  data 
showed  that  formal  education  (e.g.,  a  college  degree)  could  substitute 
for  work  experience,  that  formal  education  could  substitute  for 
vocational  training,  and  that  less  experienced  workers  needed  more 
formal  education  if  they  lack  vocational  training. 

The  EDP  occupations  were  not  established  occupations  in  the  1960 *s, 
and  employers'  responses  to  shortages  in  these  occupations  may  be  a 
special  case,  i.e.,  not  germane  to  huw  employers  handle  shortages. 
Higher  skill  occupations  that  are  new  are  not  well  integrated  into 
educational  and  employment  systems.    They  lack  generally  understood 
entry  paths  (training  sequences,  school*work  transitions,  career 
ladders)  and  developed  training  programs.    Their  job  content  tends  to  be 
unstable,  making  it  difficult  to  design  relevant  educational  programs. 
Thus,  de  facto,  they  are  higher  skill  occupations  with  low  entry 
barriers—  "bright,"  i.e.,  "trainable,"  Individuals  can  enter  them 
relatively  freely. 

Corporate  Training  and  Human  Capital 

Although  we  know  more  about  formal  corporate  training  today  than  we 
did  ten  years  ago,  we  still  lack  systematic  Information  about  which 
employers  provide  what  kinds  and  how  much  training  to  what  kinds  of 
employees  for  what  purposes  and  with  what  effect.    Thus,  the 
relationship  of  corporate  training  to  other  sources  of  education  and 
training  and  its  contribution  to  the  human  capital  of  the  labor  force 
are  not  well  understood.    Does  corporate  training  complement  or 
duplicate  other  training  sources?    Total  corporate  investments  in 
training  may  be  large.    However,  does  a  large  dollar  total  translate 
into  substantial  changes  In  human  capital?    Or  does  corporate  training 
augment  human  capital  only  marginally- -either  In  the  sense  that  the 
training  time  per  employmm  is  so  short  that  little  could  be  learned  or 
the  substance  of  the  training  has  minimal  transferability  (e.g.,  company 
safety  procedures)? 

Not  knowing  what  role  corporations  play  in  creating  human  capital 
is  like  fflisspecifying  a  model.    Or,  using  another  analogy,  it  means 
working  with  a  map  of  the  education  and  training  system  that  contains  a 
sizeable  tmrra  incognita^     Maps  of  this  kind  can  produce  at  least  two 
kinds  of  diagnostic  errors.    Tliose  using  the  map  can  assume  that  the 
unknown  domain  Is  "picking  up"  training  not  performed  in  the  known  parts 
when  in  fact  it  is  not.    Or  they  may  simply  ignore  the  unknown  part.  In 
this  case  they  will  underestimate  the  amount  and  types  of  training  being 
conducted,  potentially  funding  training  that  simply  duplicates  what 
employers  are  already  buying. 


( 

Federal  Training  Programs  and  Images  of  Labor  Markets 

The  federal  government  has  invested  billions  of  dollars  in  training 
and  employment  programs  for  various  disadvantaged  groups.  These 
programs  are  predicated  on  (often  unspecified)  assumptions  about 
relationships  between  skills  and  jobs.    Are  these  images  of  the  labor 
market  correct? 

In  the  early  1980*s  computer-based  changes  in  the  economy's 
technological  base  and  realignments  of  international  markets  combined 
with  a  recession  to  displace  a  large  number  of  experienced  workers.  As 
in  the  early  I'^SO's,  these  events  generated  considerable  policy 
discussion  about  retraining  programs.    This  solution  presumes  that  the 
problem  is  a  lack  of  skills  for  available  Jobs,  rather  than  a  lack  of 
jobs  (regardless  of  the  available  skills),  or  low  wages  for  available 
jobs  for  which  dislocated  workers  qualify.    Since  fragmentary  evidence 
indicates  that  individuals  move  fairly  freely  among  less  skilled  jobs 
apparently  without  additional  training,  the  dislocation  problem  is  not 
necessarily  a  retraining  problem. 

Conclusion 

Key  to  answering  these  and  other  questions  is  understanding 
interchangeability  among  sources  of  skills  and  how  skills  map  onto 
occupations.    In  the  United  States  we  tend  to  assume  that  a  particular  ( 
occupation  requires  a  unique  bundle  of  skills,  obtained  from  limited 
sources.    This  assumption  affects  curricular  design  and  feeds,  if  it 
does  not  produce,  anxieties  about  skill  shortages  and  oversupplies.  If 
individuals  can  only  obtain  required  training  from  highly  limited 
sources,  they  cannot  adjust  to  shortages  in  the  supply  of  these  sources. 
If  occupations  require  distinct  bundles  of  skills,  they  operate  like 
countries  with  trade  barriers.    Goods  cannot  move  freely  among  nations-* 
or,  analogously,  labor  cannot  move  freely  among  occupations  to  adjust  to 
changes  in  demand. 

In  fact,  fragmentary  but  internally  consistent  empirical  evidence 
Indicates  that  this  assumption  reflects  a  mechanistic  and  fundamentally 
Inaccurate  view  of  human  cognitive  capacities,  the  educational  system, 
the  effects  of  schooling,  and  the  nature  of  Jobs,  Substitution 
possibilities  pervade  the  educational  system  and  the  work  place. 

At  least  some  of  the  same  skills  can  be  obtained  in  alternative 
ways--in  different  courses,  from  different  schools,  during  military 
tours,  in  civilian  jobs,  or  from  volunteer  or  avocational  activities. 
Substitute  sources  of  knowledge  can  vary  in  degree  and  number,  depending 
on  the  knowledge  in  question.    Two  alternatives  may  be  complete 
substitutes,  i.e.,  virtually  indistinguishable  from  each  other,  or  only 
partial. 

In  the  labor  force  different  jobs  can  be  filled  with  individuals 
who  have  more  or  less  heterogeneous  educational  and  occupational 
backgrounds.    Again  the  substitutes  vary  in  degree  and  niimber,  depending 
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on  the  job  in  question.    Fragmentary  data  suggest  considerably  more 
interchangeability,  even  for  high  skill  jobs,,  than  we  coTononly  assume, 
especially  for  the  newer  occupations  that  technological  innovations  tend 
to  spawn.    The  substitution  possibilities,  not  surprisingly,  seem 
greater  for  less  demanding  skills,  such  as  computer  programmer,  than  for 
more  demanding  ones,  such  as  computer  systems  analyst.    However,  the 
data  show  that  students  move  between  post-secondary  fields*  of  study  and 
that  even  highly  skilled  workers  move  between  high  skill  occupations. 
The  movement  is  not  unconstrained,  but  there  is  movement. 

DATA  REQUIREMENTS 

NCES  is  not  the  appropriate  organization  to  collect  the  data 
required  to  answer  some  of  the  questions  posed  here.    For  example, 
laboratory  experiments  or  observational  studies  are  probably  preferred 
to  survey  techniques  for  studying  the  processes  by  which  employees 
accommodate  discrepancies  between  job  skills  required  and  those 
possessed. 

However,  the  NCES  and  other  federal  agencies  such  as  the  Department 
of  Labor  and  the  National  Science  Foundation  support  certain  data 
collection  activities  that  could  support  progress  on  substitution 
questions.    These  are  longitudinal  data  bases  that  measure 
characteristics  of  workers'  formal  education  and  training,  their  work 
experiences,  and  their  movement  across  time  among  occupations,  firms, 
industries,  and  geographic  areas. 

Existing  longitudinal  data  bases*-two  of  them  funded  by  the 
NCES--contain  some  information  on  the  critical  variables:  for  example. 
The  national  Longitudinal  Study  of  the  Sigh  School  Class  of  1972;  Bigh 
School  and  Beyond;    The  National  Longitudinal  Surveys  of  Young  Men, 
Young  Woaen,  Mature  Vcmen,  and  Mature  Men;  The  national  Longitudinal 
Survey  of  Youth  Labor  Market  Behavior;  Panel  on  Income  Dynamics;  and 
Experienced  Scientists  and  Engineer's.  However,  tLese  data  bases  all  lack 
the  detailed  taxonomies  of  educational  and  work  experiences  required  for 
completely  satisfactory  analyses  of  substitution  issues.  Carefully 
developed  taxonomies  are  critical  to  the  success  of  these  measures. 
Examples  of  taxonomies  that  would  have  to  be  developed  are: 

*  the  sources  of  formal  training*  such  as  vocational  training  in 
an  area  vocational  high  school,  vocational  training  in  a 
comprehenaive  high  school,  the  military,  an  avocational 
activity  with  some  kind  of  formal  instruction,  corporate 
training  delivered  outside  of  formal  educational  institutions, 
corporate  training  that  uses  formal  educational  institutions 
(by  type  of  institution),  a  public  two-year  college,  a  post-* 
secondary  proprietary  vocational  school,  a  four-year  college,  a 
university,  a  corporate  college. 

*  the  subjects  of  formal  instruction,  such  ns  particular  courses 
in  mathematics  or  computer  science,  a  course  in  using  a 
company's  text  processor  software,  a  finance  course. 
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the  amount  of  formal  training,  such  as  two  versus  four  years  of 
high  school  mathematics,  a  two  year  associate  degree  program 
versus  a  four  year  B.S.  degree,  a  four  year  versus  a  five  year 
B.S.  program  in  engineering,  a  week  versus  six  weeks  of 
management  training. 

characteristics  of  the  work  experience  that  measure  development 
and  deployment  of  skills:  for  example,  the  Census  3  digit 
occupation,  the  technology  (-gies)  used  in  the  job,  tne  nature 
of  supervisory  responsibilities,  time  diaries--similar  to  those 
used  to  measure  work  in  the  home- -to  measure  routine  and 
periodic  work  activities. 
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KNOWLEDGE  ABOUT  THE  NATION'S  TEACHERS,  OR: 
YOU'VE  LOST  THE  WAR  IF  YOU  CAN'T  FIND  THE  BATTLEFIELD* 
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INTRODUCTION 

In  1982-83  the  nation's  public  elementary  and  secondary  schools 
employed  over  2  .TillUon  classroom  teachers.    This  labor  force  Is  almost 
exactly  the  same  size  as  the  nation's  active  duty  enlisted  force  and 
c  ^ic«x  corps.  In  terms  of  the  number  employed,  the  elementary/secondary 
t       'jig  occupation  is  the  largest  professional  and  technical  occupation 
ana  among  the  five  largest  white  collar,  blue  collar,  and  service 
occupations . 

The  public  and  private  cost  of  creating  and  employing  this  labor 
force  Is  enormous.  Last  year  the  nation  spent  over  one  hundred  billion 
dollars  on  public  elementary  and  secondary  schools,  over  fifty  billion 
of  these  dollars  going  to  teacher  salaries.    Since  almost  all  public 
school  teachers  have  at  least  a  bachelor's  degree  dnd  half  have  at  least 
a  master's  degree  or  6  years  of  post-secondary  education,  the  siz*'  of 
this  labor  force  represents  an  enormous  public  and  private  investment  in 
human  capital. 

However,  despite  the  tremendous  cost  of  creating  and  ornploying 
public  school  teachers,  w    'oiow  almost  nothing  about  how  many  teachers 
we  will  need,  when,  at  what  levels,  in  which  disciplinary  fields,  and  in 
which  parts  of  the  nation.    Ve  do  not  know  if  the  publlclzei  shortages 
of  mathematics  and  science  teachers  are  general  shortages  or  spot 
shortages.    Current  efforts  to  improve  supply  and  demand  projections  are 
being  severely  limited  because  we  lack  the  fundamental  information 
required  to  predict  supply  and  demand. 

More  important  than  the  c^sts  of  creating  or  paying  it,  this  labor 
force  develops  a  substantial  part  of  the  human  capital  in  each  new 
generation  of  children.  Those  25-29  years  old  in  1980  had  completed  a 
quarter  of  a  million  yeeis  of  education,  89  percent  of  these  years  at 
the  elementary  and  secord^iy  levels.  Elementary  and  secondary  public 
school  teachers  particularly  affect  poor  children:  these  children  are 
more  apt  than  non-poor  children  to  receive  their  education  in  public 
schools,  they  are  less  apt  to  have  well-educated  parents  and  thus  rely 
more  heavily  on  teachers  for  their  academic  training,  and  a  larger 
proportion  of  their  total  years  of  education  occur  In  elemen*:ary  and 
secondary  schools. 

However,  despite  the  consequences  of  teachers'  job  p^^rformance  for 
the  human  capital  of  the  country- -especially  for  that  of  certain 
subgroups,  we  have  no  acceptable  data  on  the  quality  of  nev  or 
experienced  teachers.    For  example,  we  know  that  the  decline  in  SAT 


^This  section  is  based  on  work  conducted  for  Edward  J.  Meade,  Jr., 
of  The  Ford  Foundation. 
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scores  of  new  teachers  in  the  last  decade  i  :  greater  than  that  for  the 
total  population  of  SAT  test-takers,  but  we  do  not  know  the  relationship 
between  score  declines  and  teaching  performance.  We  have  no  way  of 
assessing  the  truth  of  the  speculation  that  scaools  are  adjusting  to 
presumed  shortages  of  teachers  by  resorting  tc  poorly  qualified 
individuals . 

REFORM  OF  THE  TEACHING  FORCE 

A  blizzard  of  recent  reports  on  American  schools  calls  for  reform 
in  our  public  schools  to  Improve  the  quality  of  the  education  that  our 
children  receive.    These  range  from  A  Nation  at  Risk,  Issued  by  the 
National  Commission  on  Excellence  In  Education^  to  the  study  conducted 
by  the  Carnegie  Foundation  for  the  Advancement  of  Teaching,  Bigb  School. 
These  reports  Identify  our  teachers  as  part  of  the  problem  and 
potentially  as  part  of  the  solution. 


Partly  in  response  to  these  reports,  state  after  state  has 
legislated  or  is  contemplating  legislation  that  will  affect  the  teaching 
force.    These  bills  will  not  only  affect  the  requirements  for  teachers, 
but  also  the  flows  of  individuals  into  and  out  of  teaching.  Thus, 
ultimately,  they  will  affect  the  stock  of  teachers— their  number,  field 
of  teaching  expertise,  and  quality.    These  reforms  range  from  salary 
increases  to  changes  in  high  school  graduation  requirements  to 
competency  tests  for  teachers. 

This  flurry  of  legislative  activity  rer  inds  one  of  the  blind  man 
and  the  elephant.    Educational  reformers  have  hold  of  different  parts  of 
the  animal — the  tail,  an  ear,  or  a  tusk,  and  each  believes  it  to  be  the 
whole  animal.    In  fact,  the  teaching  labor  force  is  a  dynamic,  human 
resource  sysftem.    At  any  point  in  time,  the  stock  of  teachers— their 
numbers,  their  specialized  skills,  and  their  quality— reflect  numerous 
prior  decisions  by  individuals.    These  choices  include  the  decision  to 
t4.ain  as  a  teacher  or  not  to  train;  to  train  as  a  high  school  teacher  or 
as  an  elementary  school  teacher;  to  train  as  a  bilingual  or  as  a  foreign 
language  teacher;  to  anter  teaching  or  nc«.  to  enter  teaching;  to  stay  in 
teaching  or  to  leav  i  it  for  home  responsibilities  or  anot^  er  occupation 
in  the  labor  forces  to  stay  in  teaching  or  to  retire;  to  stay  in  the 
same  school  or  to  move  to  another  school,  another  district,  or  another 
state;  to  re*enter  teaching  or  not  to  re-enter  teaching.    These  choices 
are  not  random,  any  more  than  choosing  to  enter,  stay  in,  or  leave  any 
occupation-'lawyer,  secretary,  manager,  chefflist--is  random.  They 
reflect  the  relative  attractiveness  of  the  occupational  alternatives 
available  to  the  individual.    As  teaching  becomes  less  attractive 
relative  to  these  alternatives,  the  number  and  quality  of  individuals 
who  elect  to  enter  and  to  stay  in  teaching  declines. 

Educational  reforms,  undertaken  for  whatever  reason,  will  intersect 
with  individual  choices  and  change  the  teaching  force  in  many  ways. 
However,  wbea  this  labor  force  is  not  conceived  of  as  a  system,  when  the 
data  do  not  exist  to  diagnose  problems  with  this  system  at  appropriate 
policymaking  levels  (national,  state,  or  district),  and  when  the  data 
do  not  exist  to  monitor,  let  alone  project,  boy  particular  reforms 
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affect  the  behaviors  of  potential ,  new,  and  experienced  teachers,  we  are 
flying  blind.    Under  these  conditions  the  chances  of  misdiagnosing 
problems  are  high;  the  chances  that  reforms  will  produce  the  changes 
that  reformers  want  are  low.    As  we  learned  so  bitterly  in  the  1970' s, 
failed  social  reforms  carr>  very  heavy  costs.    The  greatest  is  that  the 
problems  are  not  alleviated,  while  the  fickle  political  mood  that 
created  the  opportunity  for  reform  has  dissipated.    Cynicism  about  the 
responsiveness  of  schools  and  teachers  to  national  concerns  deepens ,  and 
the  political  will  to  '*try  again"  lessens.    Finally,  reforms,  whether 
successful  or  unsuccessful,  perturb  the  system,  and  turbulence  is 
costly. 

DATA  ON  THE  TEACHING  FORCE 

Thus,  while  we  need  -ction,  it  needs  to  be  informed  action. 
However,  the  state  of  the  data  required  for  informed  action  is,  quite 
simply,  shocking. .  This  is  especially  true  when  we  compare  our 
information  about  teachers  with  that  which  we  have  on  labor  forces  of 
comparable  size,  national  importance,  or  human  capital,  such  as  the 
enlisted  armed  forces  or  the  scientific  and  engineering  labor  force. 

Data  Needs 

The  questions  that  the  public  and  educational  policymakers  ask 
about  the  teaching  force  indicate  that  they  want  information  on  at  least 
six  dimensions  of  supply  and  demand.    These  are: 

1.  the  quantity,  or  number^  of  teachers; 

2.  the  quality  of  teachers; 

3.  the  number  and  quality  by  level,  a  Is^el  being  defined  as  a 
grade  category  (such  as  the  grades  4-6)  that  requires  at  some 
teachisr  skills  not  required  by  other  categories; 

4.  the  number,  quality,  and  level  by  field,  field  being  defined  as 
the  teacher's  special  field  of  training,  &ach  as  mathematics, 
bilingual  education,  biology,  English,  or  art; 

5.  the  n'^aber,  quality,  level,  and  field  of  teachers  by  their  race 
and  ethnicity;  and 

6.  the  number,  quality,  level,  field,  and  race  and  ethnicity  of 
teachers  by  their  geographic  distribution,  the  geographic  units 
of  interest  being  districts,  states,  and  the  nation  and  unique 
supply  and  demand  environments,  such  as  inner  city  schools  or 
rural  schools. 

The  reasons  for  assessing  the  number  and  quality  of  teachers  are 
self-evident.    The  level  and  field  distinctions  presume  that  teachers 
are  not  entirely  interchangeable  with  each  other.    The  extent  to  which 
teachers  with  different  educational  and  experiential  backgrounds  can 
properly  substitute  for  each  other  in  the  classrooa  is  an  empirical. 


critical,  and  anresolved  question.    However,  we  can  safely  assume  that 
not  all  levels  or  fields  are  Interchanges'  le  with  each  other. 

The  racial  and  ethnic  characteristics  of  the  teaching;  force  are 
politically,  perhaps  pedagogical ly,  snd,  In  some  states,  legally 
important «    Although  It  Is  easier  to  measure  the  racial  and  ethnic 
characteristics  of  supply  than  of  demand,  court  orders  define  demand  for 
districts  legalli^  required  to  balance  the  racial  and  ethnic  composition 
of  students  and  faculty «    These  tend  to  be  Southern  districts.    In  other 
districts  the  racial  and  ethnic  composition  of  the  students  probably 
establishes  a  demand  "range"  for  teachers  of  a  particular  race  or 
ethnicity. 

The  geographic  dimension  Is  extremely  important.    The  nation's 
public  schools  vary  greatly,  and  the  possibilities  for  quality 
variations,  geographically-specific  teacher  supply  and  denand 
imbalances,  and  resultant  educational  inequalities  among  school 
districts  and  states  are  enormous. 

Data  Sources  '  ' ' 

There  are  four  fundamentally  different  sources  of  data  on  teachers. 
One  source  Is  organizations  directly  responsible  for  the  delivery  of 
public  elementary  and  secondary  education.    These  include  schools  and 
local  boards  of  education.    The  second  source  Is  public  administrative 
and  legislative  groups  at  the  state  level,  such  as  state  education 
agencies,  state  boards  of  education,  and  education  committees  in  state 
legislatures. 

The  third  source  Is  assoclations**groups  whose  membership  consists 
of  particular  categories  of  education  practitioners  and  policymakers. 
These  include  teachers'  prganlzatlons,  such  as  the  National  Education 
Association  and  the  American  Federation  of  Teachers;  associations  of 
teachers  of  particular  subjects,  such  as  the  National  Science  Teachers 
Association,  National  Council  of  Teachers  of  English,  and  the  American 
Vocational  Association;  chief  state  school  officers  (the  Council  of 
Chief  State  School  Officers);  and  associations  that  represent  schools  in 
particular  environments,  such  as  the  Council  for  Great  City  Schools. 

The  fourth  source  Is  organizations  whose  primary  or  sole  function 
Is  data  collection  or  analysis  and  whose  substantive  focus  includes 
education.    These  groups,  fundamentally  non-'partlsan,  may  be  public  or 
non*proflt.    They  include  organizations  such  as  the  Natloaal  Center  for 
Education  Statistics,  the  Bureau  of  Labor  Statistics,  the  Bureau  of  the 
presumed  to  Imply  quantity  considerations  only.    However,  the  Census, 
the  Rand  Corporation,  the  Urban  Inrtitute,  Educational  Testing  Service, 
and  the  National  Center  for  Education  Information. 
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Status  of  Data  on  the  Teaching  Force 

State  and  local  data.    Interviews  with  the  first  two  sources  (state 
and  local  organizations)  and  with  groups  in  the  third  and  fourth 
categories  about  data  from  the  first  two  sources  indicate  the  following 
problems  with  data  collected  by  schools  districts  and  the  states. 


In  general,  teacher  data  at  the  district  and  state  levels  are, 
in  the  words  of  one  knowledgeable  respondent,  "deplorable," 
"spotty,"  and  "inconsistent." 

All  states  collect  data  from  their  districts  on  the  number  of 
student  enrollments  and  the  number  of  teachers.    These  data  are 
usually — but  not  always--collected  by  level  (elementary  versus 
secondary).    They  also  usually  have  data  on  education  revenues 
and  expenditures  by  categories,   »ut  use  such  different 
definitions  of  what  constitutes  revenues  and  expenditures  that 
these  data  are  usually  non-comparable  across  states. 

A  few  st£tes,  such  as  Florida,  Illinois,  and  New  York, 
routinely  collect  other  data  about  teachers.  For  example, 
Illinois  and  Florida  conduct  supply  and  demand  studies  for 
their  states  and  collect  the  data  required  for  fairly  simple 
models.    However,  data  such  as  these  are  usually  not  comparable 
across  states  because  the  definitions  of  variables  differ. 


Our  Interviews  suggest  that  districts  often  have  data  about 
teachers*    Since  these  data  are  almost  never  used  for  analytic 
purposes,  we  do  not  know  how  district  data  vary  in  tbiir 
accessibility,  quality,  comparability,  or  temporal  hTxd 
substantive  coverage.    The  few  cases  where  researchers  have 
tried  to  use  district  data  about  teachers  suggest  that, 
although  the  data  exist,  it  is  a  major  task  to  get  them  to  the 
point  where  they  can  be  used  to  answer  questions  about  the 
district's  teaching  force.    The  data  are  scattered  or  not 
compiled.  Our  experience  with  data  of  any  kind  collected  at 
local  levels  strongly  suggests  that  district-level  data  will 
not  be  comparable  across  districts.    Tt  also  suggests  that  the 
quality  and  temporal  and  substantive  coverage  will  be  spotty. 


We  tried  to  identify  the  conditions  that  encourage  states  and 
districts  to  collect  teacher  data.    Our  respondent  interviews  stunningly 
revealed  why  good  data  about  teachers  ^re  not  routinely  collected  by 
states  and  districts «  In  most  states  the  key  actors  do  not  conceive  of 
public  education  as  a  major  enterprise  whose  efficiency  and  quality 
might  be  impro^^ad  if  they  knew  more  about  it--for  example,  if  they  knew 
more  about  inputs  (such  as  teachers  or  laboratory  facilities),  tradeoffs 
between  inputs  (such  as  more  teachers  versus  modernized  laboratories), 
aud  about  how  inputs  get  used.    As  a  result,  they  do  not  see  the  need 
for  teacher  data. 
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Essentially,  districts  and  states  only  collect  data  in  response  to 
specific  lncentives--a  behavior  pattern  that  produces  the  "spotty"  data 
collection  on  which  so  many  have  commented.    For  example,  most  districts 
collect  data  on  enrollments  or  the  number  of  handicapped  students 
because  state  or  federal  aid  Is  contingent  on  them.    Other  data  are 
collected  in  response  to  mandates  from  state  legislatures,  state  boards 
of  education,  or  state  departments  of  education.    These  mandates  spring 
from  particular  interests  of  legislators  or  administrators  or  from 
national  concerns  about  the  health  of  education  that  find  voice  at  local 
and  state  levels. 

These  state  and  district  behaviors  are  not  surprising.    States  do 
not  collect  data  for  several  reasons,  the  philosophically  and 
politically  most  important  being  that  Americans  see  education  as 
primarily  a  local  prerogative  and  responsibility.    Although  the  balance 
of  power  between  the  state  and  local  levels  varies  within  a  state  and 
from  state  to  state,  public  education  Is  still  generally  locally 
controlled.    Since  policymakers  at  the  state  level  usually  have  very 
limited  power  to  act  on  any  data  that  they  might  collect,  they  tend  not 
to  collect  much. 

Other  reasons  that  states  do  not  collect  teacher  data  are  often 
related  to  the  same  lssue**the  distribution  of  power  among  the  local, 
state,  and  federal  levels  of  government.    These  include  state  staffs  too 
small  or  not  competent  to  collect  data,  no  pressure  to  collect  data  ("no 
mandate**},  or  the  fear  that  data  will  make  their  educational  system,  look 
weak.    States  stop  collecting  data  that  they  once  collected  because  the 
actors  change**tho8e  responsible  for  mandating  data  collection  leave 
office,  or  because  policy  questions  that  led  to  the  initial  collection 
of  data  have  been  answered. 

At  the  district  level,  there  are  economies  of  scale  problems  that 
reduce  district  incentives  to  collect  and  analyse  teacher  data.  Quality 
data  bases  on  teachers  require  substantial  resources,  especially  at  the 
front  end.    Essentially,  although  some  districts  employ  thousands  of 
teachers,  most  districts  are  small  employers.    Empirical  studies  show 
that  firms  have  very  different  investment  behaviors,  depending  on  their 
size.    For  example,  small  companies  are  much  less  apt  to  run  formal 
training  programs  for  their  employees. 

These  studies  suggest  that  we  are  more  likely  to  find  good  teacher 
data  in  the  very  large  school  systems  than  in  the  smaller  ones.  We 
suspect  that,  implicitly,  administrators  of  smaller  districts  tend  to 
think  that  they  would  not  get  enough  return  to  warrant  the  cost  of 
designing  and  maintaining  a  data  base.    For  example,  they  may  make  some 
kinds  of  decisions  only  infrequently.    Or  the  ntimber  of  individuals 
affected  by  any  given  decision  Is  small.    Or  the  district  Is  so  small 
that  administrators  know  what  Is  happening  through  personal  contact  and 
can  keep  the  relevant  data  in  their  heads.    Or  as  one  of  often  hundreds 
of  districts  in  the  state**and  of  thousands  in  the  nation,  the  district 
may  have  limited  control  over  Issues  that  they  care  about,  thus  reducing 
the  incentives  to  collect  data  germane  to  these  Issues. 
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Data  from  associations  and  statistical  and  analytic  groups.  We 
reviewed  what  data  exist  from  these  sources  for  estimating  the  six 
dimensions  of  current  and  projected  teacher  supply  and  demand.  This 
review  revealed  the  following  data  problems. 

1.  We  have  no  data  from  any  source  on  certain  variables.    There  are 
no  data  that  can  be  used  In  any  serious  way  to  assess  the  quality  of  new 
or  experienced  teachers.    Ve  have  no  data  on  the  geographic  mobility 
patterns  of  new  teachers— where  they  look  for  Jobs  and  how  far  and  where 
they  move  to  take  a  Job.      Although  we  have  old  data  on  the  rates  at 
which  experienced  teachers  change  schools,  districts,  or  states  in  which 
they  are  teaching,  we  lack  even  old  data  for  converting  these  aggregate 
rates  Into  flows  between  specific  states  and  districts. 

V/e  have  no  data  on  teacher  benefit  packages.    Thus,  we  do  not  know 
what  Is  in  these  packages,  how  they  vary,  or  how  transferable  components 
such  as  retirement  benefits  are  across  school  districts  and  states..  Any 
serious  estimate  of  the  total  compensation  package  for  teachers  needs  to 
include  non-wage  benefits.    Although  we  have  data  on  whether  districts 
offer  special  monetary  incentives,  we  do  not  know  amounts  or 
probabilities  of  receiving  these  payments.  The  amounts  or  chances  of 
receiving  them  may  be  so  small  that  th«7  can  be  discounted  as  incentives 
and  Ignored  in  estimating  compensation  packages. 

2.  We  have  only  very  old  data.    We  have  only  old  data  for  some 
variables,  bui:  changes  in  factors  that  affect  teacher  supply  and  demand, 
such  as  changes  in  the  relative  attractiveness  of  teaching,  make  these 
data  obsolete.    For  example,  data  on  teacher  turnover  are  15  years  old. 

3.  We  have  no  time  series  on  the  variable.    One  of  the  best  ways  to 
assess  the  effect  of  a  new  policy  is  to  look  for  changes  in  the  variable 
in  question  after  the  introduction  of  the  policy.    These  assessments 
require  measures  of  the  variable  before,  as  well  as  after,  the  new 
policy  is  introduced**and  preferably  measures  at  several  time  points 
before  the  policy  change.    We  rarely  have  comparable  measures  of  a 
variable  across  time. 

4.  We  have  data,  out  from  different  sampling  frames,  differently 
worded  questions,  and  different  time  periods.    These  non*compar abilities 
make  it  impossible  to  pool  available  data  to  increase  the  statistical 
precision  of  "snapshot"  (cross-sectional)  estimates  or  to  create  a  time 
series . 

5.  We  have  only  partial  data.    This  problem  arises  for  most 
variables  of  interest.    We  will  have  data  on  some  issue,  such  as  the  age 
structure  of  the  teaching  force  or  salaries,  but  lack  these  data  by 
ijoportant  distinctions  such  as  level  (elementaary  or  secondary,  for 
example),  field  (such  as  mathematics  or  English),  or  for  different 
administrative  units  (nation,  state,  district,  school).    There  is 
tremendous,  policy-relevant  heterogeneity  in  the  teaching  system,  and 
having  data  for  the  total  force  without  these  distinctions  renders  them 
almost  useless. 
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6.  The  sources  of  data  are  not  credible.    When  groups  with 
political  interests  collect  the  data,  even  if  these  data  are  entirely 
valid,  they  remain  suspect.  The  National  Education  Association  is  the 
only  source  for  many  data  on  teachers^T  alaries,  for  example,  and  for 
several  variables  measured  in  their  survey  of  the  Status  of  the  American 
Public  School  Teacher,  such  as  working  conditions  and  job  satisfaction. 
These  data  seem  professionally  collected  and  reported.    However,  the  N£A 
is  a  stakeholder  in  policy  debates,  and  their  data  are  not  necessarily 
seen  as  trustworthy. 

7.  The  measures  have  validity  problems.    Important  measures  whose 
validity  is  questioned  are  the  measures  of  teacher  shortages  and  out* 
of*field  teaching.    Recent  national  survey  data  on  these  variables  do 
not  indicate  serious  shortages  even  in  the  fields  of  mathematics  and 
science;  they  show  low  rates  of  out*of*field  teaching.    These  data  do 
not  fit  what  many  think  is  happening  in  schools.    A  source  of  the 
discrepancy  between  data  and  impression  lies  in  the  definitions  of  the 
key  concepts.    For  example,  these  data  refer  to  "shortage"  defined  as 
unfilled  job  vacancies.    However,  what  many  mean  by  "shortage"  is  an 
inadequate  supply  of  appropriately  trained  and  experienced  teachers. 
Data  will  not  be  trusted  unless  those  who  need  them  agree  on  the 
measurement  system  behind  the  data**on  the  definition  of  the  concept  to 
be  measured  and  on  its  operationalization,  as  embodied  in  a  specific 
measure. 

8.  Required  data  may  exist,  but  their  potential  for  supply  and 
demand  analyses  of  the  teacher  labor  force  has  not  been  assessed.  For 
example,  the  Bureau  of  Labor  Statistics  of  the  Department  of  Labor 
collects  data  on  separation  rates  by  occupation  and  reason  (e.g., 
retirement).    Can  these  data  be  used  to  estimate  teacher  turnover  rates 
and  post*exit  destinations?    Vhat  are  their  limits?    The  Census  Bureau 
collects  data  on  geographic  mobility  by  occupation.    Can  these  data  be 
used  to  estimate  flows  of  teachers  in  and  out  of  geographic  areas? 

9.  The  current  data  system  seems  inefficient.    For  example,  the 
National  Center  for  Education  Statistics,  Equal  Employment  Opportunity 
Commission,  and  Office  for  Civil  Rights  send  separate  surveys  to  the 
same  respondents.    A  single,  longer  survey  would  eliminate  non- 
comparabilities  introduced  by  different  agency  procedures  and  different 
data  collection  times.    A  consolidated  survey  should  also  reduce  the 
burden  on  respondents.    In  other  cases  the  same  data  seem  collected  at 
state  and  district  levels,  but  data  collected  from  districts  can  be 
aggregated  to  yield  state  estimates. 


THE  ROLE  FOR  THE  NATIONAL  CENTER  FOR  EDUCATION  STATISTICS 


In  this  section  we  describe  why  we  think  the  the  primary 
responsibility,  authority,  and  resources  for  collecting  data  on  the 
nation's  teaching  force  should  reside  in  the  NCF"     Ve  also  describe 
roles  other  organizations  might  play  in  conjunction  with  the  NCES. 
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Why  Vest  Data  Responsibility  in  the  NCES? 

The  National  Center  for  Education  Statistics,  or  the  NCES,  is  the 
nation's  federal  data  center  on  education  questions--public  and  private; 
elementary,  secondary,  and  post*secondary;  student  anrollments, 
dropouts,  and  graduates;  revenues  and  expenditures  of  public  schools;, 
institutions  and  teachers. 

.  The  function  performed  by  the  NCES  has  been  performed  by  the 
federal  government  since  the  nineteenth  century,  although  this  function 
has  been  vested  in  differently  organized  units  with  different  names.  In 
fact,  the  main  rationale  for  the  old  Office  of  Education  and  its 
organizational  predecessors  was  the  collection  and  dissemination  of 
statistics  on  education.    Although  NCES  currently  lacks  a  cogent  vision 
of  what  data  should  be  collected  about  teachers,  it  operates  in  the  non- 
political  and  professional  tradition  of  the  U.S.  Census  Bureau  and  the 
U.S.  Bureau  of  Labor  Statistics  (BLS) .    Just  as  the  politically 
sensitive  monthly  unemployment  figures  released  by  the  BLS  are 
considered  independent  of  the  political  party  in  power,  so  NCES  data  are 
considered  independent  of  the  many  stakeholders  in  education. 

Thus,  the  NCES  meets  three  criteria  for  an  adequate  data  system 
about  teachers.    First,  positioned  at  the  federal  level,  it  is  formally 
authorized  to  work  with  all  of  the  nation's  school  districts  and  states. 
Second,  it  receives  an  annual  Congressional  appropriation  of  funds  to  be 
used  for  the  express  purpose  of  collecting  data  about  education. 
Including  data  about  teachers. 

Finally  and  perhaps  most  important,  it  is  independent  of  the  many 
stakeholders  in  education.  To  be  used,  data  have  to  be  trusted.  Their 
collection  and  analysis  must  be  and  must  be  seen  to  be  non-partisan.  If 
a  group  with  a  political  stake  collects  the  data,  no  matter  how  valid 
the  data  are,  they  will  be  perceived  as  compromised. 

By  virtue  of  its  federal  position,  the  NCES  is  independent  of  any 
state  or  district.    It  is  independent  of  the  many  associations  ijc 
education.    It  is  subject  to  the  balance  of  power  that  affects  all 
federal  agencies.    Finally,  it  is  Included  in  the  special  agreement 
struck  between  the  Congress  and  the  Executive  Branch  about  the 
importance  of  non-partisan  data  on  issues  of  national  import.  This 
agreement,  althou^  it  has  to  be  defended  periodically,  has  created  an 
independent,  non-partisem  status  for  the  federal  statistical  agencies. 

It  can  be  argued  that  since  states  and  school  districts  make  most 
of  the  decisions  about  the  educational  system,  they,  and  not  a  federal 
agency,  are  the  logical  units  for  collecting  data  on  teachers.    We  argue 
that  there  are  several  compelling  reasons  to  keep  the  basic  data 
collection  at  the  federal  level.    First,  for  reasons  specified  earlier, 
most  states  and  districts  have  historically  collected  only  minimum 
information  about  the  elementary  and  secondary  public  school  system, 
including  teachers.    We  have  no  reason  to  think  that  the  conditions  that 
discourage  data  collection  at  these  levels  will  permanently  change  in 
all  states. 
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Second,  many  public  education  issues  require  data  comparable  across 
states.    The  issue  may  involve  geographic  units  larger  than  an 
individual  state--for  example,  estimates  for  the  nation  or  for  a 
category  of  states,  such  as  the  sunbelt  states.    Or  it  may  require  the 
ability  to  differentiate  general  from  state-specific  problems. 

For  example 9  many  issues »  while  not  federal,  are  framed  as  national 
issues,  i.e.,  true  for  all  states.    Most  recently,  these  include  the 
quality  of  secondary  education  and  shortages  of  mathematics  and  science 
teachers.    Without  comparable  district  and  state-level  data,  national 
study  commissions  or  federal  policymakers  cannot  distinguish  general 
from  dramatic,  but  localized,  problems.    The  legislators  of  a  specific 
state  or  the  board  of  education  of  a  specific  community  cannot  determine 
when  something,  while  generally  true  for  the  country,  is  not  true  for 
them. 

Thus,  if  states  or  districts  are  the  sources  of  teacher  data,  the 
data  have  to  be  comparable  across  states  or  districts.    Although  in 
theory  procedures  could  be  established  that  would  yield  comparable  state 
or  district  data,  in  practice  this  becomes  a  formidable  task  for  more 
than  a  very  few  standard  variables. 

Third,  states  and  districts  cannot  obtain  data  on  certain  key 
teacher  supply  and  demand  questions.    These  are  questions  that  involve 
relationships  between  states— for  example,  questions  about  the 
geographic  mobility  of  newly  trained  and  experienced  teacbers--and 
individuals  not  employed  by  a  state's  school  district--for  example, 
questions  about  factors  that  affect  undergraduates'  choices  of  fields  of 
study  or  the  decisions  of  those  in  the  reserve  teaching  pool  to  enter 
(re-enter)  teaching. 

Fourth,  states  and  districts  are  not  necessarily  the  best  agents 
for  collecting  sensitive  data  from  teachers  in  district  or  state  employ. 
For  example,  teachers  may  be  reluctant  to  report  their  job  satisfaction, 
retirement  plans,  or  plans  to  change  occupations  if  the  data  are 
collected  by  their  employers. 

Rol«  for  Other  Groups 

An  adequate  data  system  about  teachers  must  provide  the  data  that 
all  of  the  nation's  major  users  require.    These  users  include  those  with 
public  responsibilities  for  elementary  and  secondary  education  and  large 
interest  groups  with  legitimate  political  objectives.    In  other  words, 
they  include  users  at  different  levels  of  govenunent- -national,  state, 
and  local,  such  as  state  or  county  boards  of  education,  state  and  local 
education  agencies,  national  and  state  legislators,  and  the  U.S. 
Department  of  Education.    They  also  include  interest  groups,  such  as 
representatives  of  minority  groups,  partisan  state  legislators,  and 
representatives  of  the  teachers'  organizations. 
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Thus,  although  we  argue  that  the  primary  responsibility,  authority, 
and  resources  for  collecting  data  on  teachers  be  lodged  in  the  NCES, 
designing  that  system  requires  the  participation  of  the  major  users  of 
those  data.    A  participatory  process  is  a  slow  process,  but  it  will 
increase  the  utility  and  political  fairness  of  the  ultimate  data  system. 
It  will  also  increase  the  chances  that  state,  district,  and  association 
groups  will  co-operate  with  the  NCES  in  implementing  the  system. 
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I.    INTRODUCTION  AND  SUMMARY 

Since  education  is  a  local  responsibility,  the  purpose  of  federal  data 
collection  is  to  help  the  citizenry  and  political  leadership  of  individual 
states  and  localities  to  make  better  decisions.  Better  decision  making  at  the 
local  level  requires  two  things  (1)  better  understanding  of  how  schools  influ- 
ence learning  and  how  effective  schools  develop  and  evolve  and  \l)  comparative 
data  on  the  performance  of  state  and  local  educational  systems  so  the  citizenry 
and  public  officials  can  hold  local  school  administrators  accountable.  The 
collection  and  publication  of  data  is  a  public  service  that  benefits  everyone 
in  the  country  and  thus  is  properly  a  federal  function. 

Achieving  the  first  goal— better  understanding  of  how  to  improve 
education-*requires  large  longitudinal  data  sets  like  the  National  Education 
Longitudinal  Study  of  1988  (NELS88)  which  follow  students  through  their  school- 
ing and  into  the  labor  market.  What  is  needed  is  large  data  sets  which  merge 
many  different  kinds  of  data: 

<  •  achievement  tests  for  a  great  variety  of  subjects  (not  just  one 

^  subject  at  a  time)  which  have  separate  subtests  for  higher  order 

skills  and  basic  skills 

•  aptitude  tests 

•  school  records  on  courses  taken,  grades,  absenteeism,  discrip- 
tions  of  special  education  service  received,  and  test  scores 

•  questionnaires  measuring  student  background  and  attitudes  (i.e.* 
locus  of  control) 

•  parent  questionnaires 

•  surveys  of  the  students,  teachers,  guidance  counselors  and  prin- 
cipals 

•  multiple  administrations  of  tests  and  surveys  about  2  to  4  years 
apart 

•  follow-up  data  on  labor  market  outcomes  with  complete  histories 
of  employment  and  unemployment  up  to  age  40 

•  interviews  with  employers  to  measure  skills  and  job  performance 
of  recent  school  leaners. 

The  public  needs  to  be  able  to  monitor  the  progress  and  achievements  of 
^  their  state  and  local  systems  of  education.  The  logical  point  of  comparison  is 
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the  progress  and  achievements  of  other  states  so  the  primary  focus  of  NCES's 
core  data  program  should  be  on  providing  data  that  is  comparable  across  tates> 
Emphasis  shpuld  be  pUced  on  measuring  outcomes  rather  than  inputs.  The  key 
data  elements  t^at  need  to  be  added  to  the  program  are  the  following: 

f  Performance  on  achievement  tests  in  a  variety  of  subjects  that 
all  (or  almost  all)  students  in  the  school  take*  (It  is  feasible 
to  put  different  tests  on  a  common  metric  and  the  effort  should 
be  made.) 

•  Comparisons  of  a  states  relative  performance  in  tests  for  first 
graders  with  performance  in  later  grades,  (This  is  a  better 
measure  of  educational  effectiveness  than  mean  test  scores  which 
are  heavily  effected  by  the  social  background  of  the  student 
body  • 

•  Separate  test  scores  for  basic  and  high  level  skills. 

•  State  comparisons  of  the  economic  outcome's  of  schooling:  earn- 
ing, employment,  occupation. 

•  Time  series  and  regional  data  on  salary  offers  to  recipients  of 
associates  degrees  by  area  of  study. 

•  Time  series  and  regional  data  on  the  economic  outcomes  of  school- 
ing from  an  Improved  Current  Population  Survey. 

•  Time  series  and  regional  data  on  how  schools  influence  the  devel- 
opment of  character  (e.g.,  locus  of  control). 

•  International  comparative  data  on  achievement  in  particular 
subjects  and  on  time  use. 
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II.    NEED  FOR  DATA  THAT  ACCURATELY  COMPARES 
STATES  AND  LOCAL  EDUCATION  AGENCIES 

Responsibility  for  and  administration  of  elementary /secondary  education 
lies  in  ..tate,  local  and  private  hands.  It  is  important  to  remember  this  fact 
when  planning  a  federally  sponsored  system  of  data  collection  on  elementary  and 
secondary  education.  The  primary  purpose  of  the  common  core  data  program  is, 
therefore,  not  to  help  the  federal  government  make  better  decisions  but  to  help 
the  citizenry  and  political  leadership  of  individual  states  monitor  the  prog- 
ress and  achievements  of  the  educational  system  in  that  state.  Progress  and 
achievements  can  be  defined  only  when  seme  standard  of  comparison  is  available. 
Since  the  natural  point  of  comparison  is  the  progress  and  achievements  of  other 
states,  the  key  requirement  for  the  common  core  data  program  should  be  the 
accuracy  of  the  across  state  comparisons  of  the  levels  (e.g.,  expenditure  per 
pupil  in  average  daily  attendance)  or  changes  (e.g.,  changes  in  performances  on 
standardized  tests)  in  various  indicators  of  effort  and  performance. 

In  order  to  effectively  manage  their  responsibilities  on  a  day-to-day 
basis,  state  governments  and  local  educational  agencies  (LEAs)  need  timely  and 
accurate  data  on  enrollment,  staff,  revenues,  and  expenditures  for  each  of  the 
schools  and  school  districts  under  their  charge.  From  the  point  of  view  of  the 
state  and  local  administrators,  the  primary  requirement  on  management  informa- 
tion system  (HIS)  data  Is  comparability  across  schools  and  school  districts, 
consistency  over  time  and  accuracy  (conformity  to  the  definitions  and  concepts 
used  in  that  state's  educational  legislation  and  administrative  regulations). 
When  state  legislation  changes,  the  data  that  needs  to  be  collected  will  change 
Olid  consistency  over  time  will  be  set  aside  in  favor  of  accuracy. 

Historical  accident  and  different  needs  for  data  have  resulted  in  MIS  data 
that  differ  in  concept  and  accuracy  from  state  to  state.  Constructing  valid 
estimates  of  national  statistics  through  the  aggregation  of  MIS  data  is,  thus, 
no  easy  matter.  Since  estimates  of  national  aggregates  can  be  obtained  wher^ 
necessary  by  other  means  (e.g.,  sample  surveys),  the  common  core  data  program 
should  not  have  the  estimation  of  national  aggregates  as  its  central  goal.  The 
central  goal  of  the  common  core  data  program  should  instead  be  to  provide  high 
quality  data  that  are  comparable  across  states.  This  implies  that  NOES  needs 
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to  work  cooperatively  with  the  states  to  insure  that  data  reported  are  consis- 
tent with  the  common  definitions  that  have  been  adopted.  If,  however,  specific 
data  elements  from  some  states  are  not  comparable  to  the  data  frcm  most  other 
states,  the  data  element  should  either  not  be  published  or  be  published  in 
italics  with  a  footnote  describing  reasons  for  the  lack  of  comparability.  When 
this  occurs  national  aggregates  should  be  reported  only  for  the  states  that 
have  provided  comparable  information. 
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III.    THE  NEEr  TO  MEASURE  EDUCATIONAL  OUTCOMES 


The  statistics  reported  in  The  Digest  of  Educational  Statistics  and  The 
Conditirn  of  Education  are  almost  entirely  measures  of  inputs  into  education 
rather  than  measures  of  the  outcomes  of  education.  Of  the  70  tables  in  the 
1984  edition  of  The  Condition  of  Education,  only  3  displayed  data  on  test  score 
outcomes  of  education  and  none  displayed  data  on  economic  outcomes  of  educa- 
tion. A  categorization  of  the  tables  in  The  Digest  of  Educational  Statistics 
(see  table  1)  reveals  that  it  did  only  slightly  better  in  covering  educational 
outcomes.  Of  the  173  tables  in  the  1983/84  edition,  there  were  9  tables  dis- 
playing test  score  outcome  data  and  9  displaying  data  on  economic  outcomes 
(labor  force  status,  occupation  and  earnings).  The  tests  covered  material  that 
should  be  learned  before  entering  college  so  all  9  of  these  tables  can  be 
considered  outcome  measures  for  elementary  and  secondary  education.  Of  the  9 
tables  displaying  data  on  economic  outcomes,  3  tables  addressed  the  experience 
of  bachelor  degree  holders,  1  the  experience  of  recipients  of  masters  and  Ph.D. 
degree  holders,  3  the  experience  of  high  school  graduates  and  dropouts  and  2 
tables  presented  data  on  all  levels  of  educational  attainment.  There  were  no 
tables  devoted  to  data  on  the  labor  market  success  of  completers  of  1  or  2  year 
occupational  programs  or  associates  degree  holders.  There  were  3  tables  on 
high  school  diplomas  awarded  and  4  tables  on  years  of  schooling  completed. 
These,  however,  are  measures  of  credentials  awarded  not  of  learning.  The  great 
var  .ation  in  the  educational  standards  across  the  country  and  the  decline  in 
stdndards  over  time  call  into  question  the  usefulness  of  these  statistics  for 
comparisons  across  time  and  space  of  the  performance  of  the  educational 
system.^ 

Table  1  also  presents  data  ^n  changes  over  time  in  the  subjects  covered  in 
The  Digest  of  Education  Statistics.  The  number  of  tables  devoted  to  the  eco- 
nomic outcomes  of  schooling  has  been  stable  over  time.  The  number  of  tables 
providing  test  performance  data  rose  from  2  in  1969  to  9  in  1983  due  to  the 
availability  of  data  from  the  National  Assessment  of  Educational  Progress. 

The  Effects  or  Jata  Availability 

There  are  important  interactions  between  data  availability  and  the  evolu- 
tion of  public  policy.  Statistical  agencies  recp'^nd  (often  with  a  considerable 


TABLE  1 

COVERAGE  OF  THE  DIGEST  OF  EDUCATIONAL  STATISTICS 


1969  1975  1983 

Nat.  State       Nat.  State     Nat.  State 


Educational  Outcomes 


Economic  Outcomes 

9 

0 

11 

0 

9 

0 

Test  Score  Outcomes 

1 

1 

5 

0 

9 

0 

ducational  Credentials  and  Inputs 

Credentials  &  Yrs  of  School  Completed 

3 

5 

5 

3 

4 

3 

Elementary  Secondary  Education  Inputs 

30 

21 

23 

21 

21 

24 

All  Levels  Inputs 

11 

2 

12 

3 

6 

2 

Higher  Education  Degrees 

4 

2 

10 

2 

19 

1 

Higher  Education  Inputs 

36 

13 

35 

11 

31 

14 

Adult  &  Vocational  Education 

0 

0 

9 

1 

6 

•> 

Federal  Programs 

5 

2 

6 

3 

3 

4 

International  Education 

6 

6 

8 

Libraries  . 

7 

1 

8 

2 

5 

2 

R&D 

6 

7 

0 

Equal  Educational  Opportunity 

5 

2 

0 

123 

47 

139 

47 

121 

52 

170  186  173 


Odd  numbered  columns  are  counts  of  tables  which  present  data  for  the  nation  as 
a  whole.    Even  numbered  columns  are  counts  of  tables  which  present  data  com- 
paring states  or  in  a  few  instances  specific  institutions  of  higher  education 
or  libraries.    Input  data  includes  information  on  students*  staff,  revenues, 
and  expenditures. 
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lag)  to  the  concerns  of  policy  makers,  but  in  addition,  data  availability  has 
independent  effects  on  the  evolution  of  public  policies. 

The  availability  of  statistics  recording  progress  over  time  and  providing 
geographical  comparisons  attract  public  and  policy  maker  attention  to  a  sub- 
ject. The  availability  of  data  on  inputs— numbers  of  students,  numbers  of 
teachers  and  expenditure--and  the  lack  of  data  ,on  outcomes  contributed  to  an 
unfortunate  tendency  during  the  60s  and  70s  for  public  attention  and  policy 
analysis  to  focus  on  a  limited  number  of  measureable  inputs  into  learning 
rather  on  its  outcomes. 

The  Nation  at  Risk  report  has  made  the  quality  and  effectiveness  of  educa- 
tion the  central  educational  policy  question  of  the  1980s.  The  kind  of  data 
included  in  government  publications  is  changing  as  a  result.  But  it  is  doubt- 
ful that  the  National  Commission  on  Excellence  In  Education  would  have  had  such 
an  impact  (and  might  not  have  even  been  appointed),  if  there  had  not  been  data 
available  on  (1)  declining  SAT  scores  and  performance  on  NAEP  exams  and  (2)  the 
poor  relative  performance  of  American  students  in  math  and  science  in  the 
(  International  Education  Agency's  studies.  The  future  of  the  educational  reform 

movement  will  also  be  influenced  by  data  availability.  Since  policy  is  made  at 
the  state  and  local  level,  there  is  a  great  need  for  performance  measures  that 
are  specific  to  particular  states  and  comparable  across  states  and  over  time. 


Test  Score  Outcome  Data 

The  Department  of  Education  has  begun  the  process  of  supplying  the  need 
for  comparative  data  on  educational  performance  by  making  data  on  state  means 
on  the  ACT  and  SAT  scores  and  their  changes  over  time  widely  available  (Wall 
Chart  and  Indicators).  The  SAT  and  ACT  tests,  however,  are  curriculum  free 
tests  of  aptitude  for  college  and  as  such  are  not  appropriate  goals  for  in- 
struction. They  are  also  limited  to  college  bound  students.  It  is  important 
that  states  be  able  to  monitor  their  progress  towards  achieving  instructional 
goals  for  all  their  students  and  across  all  grade  levels. 

Consequently,  high  priority  should  be  given  to  publishing  data  on  the 
following: 

1.   Performance  on  Achievement  tests  by  subject,  by  age  group  (or 
jrade),  by  minority  status  and  by  state.  Many  states  mandate 
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hat  all  st'idents  in  the  state  take  particular  achievement 
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tests  at  specified  points  in  their  educational  career.  The 
problem  is  that  different  states  use  different  tests.  A  study 
of  the  feasibility  of  linking  together  the  various  widely  used 
achievement  tests  has  been  funded  so  a  methodology  for  making 
the  results  comparable  across  most  states  will  be  available 
soon.  Disaggregation  by  subject  1s  Important  because  It  helps 
states  monitor  curriculum  reforms  that  are  specific  to  particu- 
lar subjects, 

2.    Performanc-e  op  competency  tests  necessary  to  receive  a  high 
school  degree  and  how  thai  has  changed  over  time. 

Consideration  should  also  be  given  to  publishing  similar  statistics  for  the 
larger  urban  school  districts. 

Colleges  also  need  to  be  made  accountable;  therefore,  data  on  the  academic 
perfo-^nce  of  their  students  need  to  be  published.  This  could  be  accomplished 
by  publishing  Graduate  Record  Exam,  SAT  and  ACT  test  scores  for  Individual 
colleges  and  for  all  of  the  colleges  In  a  state  disaggregated  by  type  of  insti- 
tution. Since  the  mean  score  will  depend  on  the  proportion  of  a  college's 
graduates  which  take  the  Graduate  Record  Exam,  It  would  be  essential  to  publish 
this  proportion  along  with  the  score. 

Statistics  like  those  In  the  wall  chart  titled  State  Education  Statistics 
and  those  described  above  will  Inevitably  be  used  to  answer  questions  like  ''How 
are  we  doing  relative  to  other  states?"  The  public  and  elected  officials  will 
use  such  numbers  to  assess  the  effectiveness  of  the  educational  system  in  their 
state  and  to  monitor  the  progress  of  state  reform  efforts.  The  publication  of 
the  wall  chart  suggests  such  uses  are  Intended. 

There  are  dangers,  however.  Some  states  are  apparently  planning  to  use 
the  mean  test  scores  for  school  districts  as  a  very  powerful  tool  of  over- 
sight. 

In  the  past  year,  four  states— Arkansas,  Kentucky,  South  Carolina, 
and  Texas--have  Included  provisions  for  academic  bankruptcy  in 
their  reform  bills.  The  bills  in  all  four  states  ask  that  local 
school  districts  meet  certain  minimum  levels  of  student  achieve- 
ment and  other  standards  or  face  the  possibility  that  the  state 
will  mandate  additional  reforms  for  the  district,  even  Including 
wresting  control  of  the  local  school  system  from  the  local  school 
board--the  academic  equivalent  of  putting  the  district  into 
receivership.    (Anderson  and  Pipho,  1984;  p.  211) 

If  decisions  of  this  magnitude  were  to  be  made  without  taking  into  account  the 
demographic  background  of  the  students  in  the  district,  great  injustices  could 
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be  done.  While  state  comparisons  of  performance  could  not  conceivably  lead  to 
the  federal  government  imposing  changes  on  a  particular  state's  educational 
system,  they  might  have  powerful  political  consequences.  For  example,  they 
could  influence  the  outcoine  of  an  election  for  State  Superintendent  of  Public 
Instruction. 

Comparisons  of  SATs,  ACTs  or ■ achievement  test  scores  across  states  prob- 
ably reflect  racial  and  social  background  differences  of  their  population  more 
than  they  reflect  the  quality  of  the  schools  in  that  state.  Policy  makers  and 
the  public  need  a  statistic  for  comparing  the  performance  of  state  educational 
systems  that  is  less  subject  to  such  biases.  Comparative  data  that  purport  to 
measure  the  performance  of  an  educational  system  but  in  fact  measure  the  tal- 
ents and  background  of  the  students  could  confuse  the  public  debate  on  educa- 
tion more  than  they  enlighten  it.  Only  a  tiny  minority  of  the  users  of  such 
statistics  will  be  sophisticated  statisticians  or  educational  researchers  who 
will  estimate  multivariate  models  that  control  for  the  student  background 
characteristics.  Consequently^  the  data  needs  to  be  reported  in  ways  which 
make  the  comparisons  across  states  as  fair  and  valid  as  possible.  It  is  there- 
fore essential  that  someone  (NCES,  NIE  or  a  researcher  under  contract)  be  given 
the  task  of  producing  perfomance  indicators  that  adjust  for  the  social  back- 
ground of  the  students  and  the  talents  they  bring  with  them  at  school  entrance. 
The  following  should  be  considered: 

3.  Changes  in  the  relative  performance  of  particular  cohorts  of 
cm  i  or  en  tr  (Mil  particular  states.  5'ich  a  statistic  can  be 
constructed  Dy  putting  scores  from  tests  administered  in  the 
first  and  later  gt ades  on  a  common  metric  (e.g.,  standard 
deviation  units,  grade  equivalents  or  state  rankings)  and  then 

*  examining  how  the  states  performance  on  this  ranking  changes  as 
grade  level  increases.  While  such  comparisons  might  be  made 
for  different  tests  given  at  a  point  in  time,  conparisons  would 
be  more  valid  If  the  cohort  was  held  constant.  This  would  be 
done  by  calculating  state  rankings  on  1st  grade  scores  in  1976 
and  then  comparing  them  to  the  rankings  on  8th  grade  scores  in 
1984.  Grade  equivalents  and  standard  deviation  units  will 
produce  different  results.  If  grade  equivalents  are  to  be 
reported,  standard  deviation  units  should  be  reported  as  well 
and  the  difference  between  the  two  should  be  explained. 

4.  Achievement  test  scores  (levels  and  gain  scores)  that  have  been 
adjusted  for  the  demographic  composition  of  the  states  stu- 
Qents.  Another  way  or  reducing  the  bias  prooiem  discusTe? 
above  is  to  estimate  statistical  models  predicting  achievemrint 
as  a  function  of  student  background  characteristics  using  state 


aggregate  data  and  then  report  only  the  residuals  from  such  a 
model. 

Assessing  Higher  Order  Skills 

Even  though  most  basic  skills  should  be  learned  prior  to  the  end  of  junior 
high  school,  many  students  arrive  in  high  school  without  a  through  grounding  in 
basic  skills.  This  fact  and  great  public  stress  on  the  importance  of  basic 
skills  seems  to  have  resulted  in  high  school  teachers  coming  to  view  the  teach- 
ing of  basic  skills  as  their  number  one  goal.  When  10,360  high  school  teachers 
surveyed  as  part  of  the  HSB  supplementary  survey  were  asked  to  rank  8  different 
goals  of  their  teaching,  44  percent  placed  "Basic  literacy  skills"  at  the  top 
(see  table  2).  Only  19  percent  gave  first  rank  to  "Academic  excellence  or 
mastery  of  the  subject  matter  of  the  course."  High  school  should  be  a  place 
for  developing  higher  order  skills  and  reasoning  ability  such  as  inference, 
analysis,  interpretation,  and  applying  general  principals  to  specific  cases. 
The  growth  of  testing  and  the  tendency  of  most  tests  to  focus  on  lower  rather 
than  higher  order  skills  may  be  contributing  to  a  narrowing  of  the  high 
school's  teaching  agenda.  The  National  Council  of  Teachers  of  Mathematics  is 
concerned  about  this  trend  and  has  called  for  ^  revision  of  both  the  mathe- 
matics curriculum  and  the  te'>ts  used  to  assess  progress.   It  recommended  that: 

•  "Problem  solving  be  the  focus  of  school  mathematics  In  the  19SOs 

•  Basic  skills  In  mathematics  be  defined  to  encompass  more  than 
computational  ability 

•  Stringent  standards  of  both  effectiveness  and  efV  ciency  be 
applied  to  the  teaching  of  mathematics 

•  The  success  of  mathematics  programs  and  student  learning  be 
evaluated  by  a  wider  range  of  measures  than  conventional  testing" 
(National  Council  of  Teachers  of  Mathematics,  1980;  p.  1) 

Similar  problems  exist  In  other  subject  areas. 

Testing  can  be  designed  to  assess  higher  order  skills.  The  recent  revi- 
sion of  The  California  Achievement  Tests  had  better  assessment  o.  higher  order 
skills  as  an  important  objective.  The  College  Board  and  The  National  Assess- 
ment of  Educational  Progress  have  successfully  implemented  standardized  methods 
of  assessing  writing  ability.  An  effective  way  to  Insure  that  we  do  not  forget 
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TABLE  2 

THE  GOALS  OF  SECONDARY  SCHOOL  TEACHERS 


Rank 


1 

2 

3 

4 

5 

6 

7 

8 

Basic  Utera^  skills  (reading,  math,  vritingt 
speaking) 

44 

18 

12 

8 

7 

6 

4 

2 

Academic  excellence,  or  nastery  of  the  subject  . 
matter  of  the  course 

19 

18 

16 

U 

11 

9 

9 

6 

Citizenship  (understanding  institutions  and 
public  values) 

4 

7 

9 

12 

16 

21 

22 

9 

Specific  occupational  skills 

4 

5 

7 

8 

9 

12 

21 

35 

Good  work  habits  and  self -discipline 

18 

28 

22 

14 

9 

5 

3 

1 

Personal  growth  and  fulfillment  (self-esteem, 
personal  efficacy,  selfHcnowledge 

13 

14 

16 

19 

16 

13 

7 

3 

Huncn  relations  skills  (cultural  understanding, 
getting  along  with  others) 

6 

10 

13 

17 

20 

18 

12 

4 

Moral  or  religious  values 

9 

6 

6 

7 

9 

11 

17 

35 

NOTE;    Cell  entries  are  the  percent  of  teachers  vho  assigned    the  goal  a  given 
rank.    Except  for  rounding  error  each  row  should  sum  to  100*    Columns  some- 
times sum  to  more  or  leas  than  100  because  eome  teachers  gave  different  goals 
the  same  rahk« 


The  question  vas:    "If  you  had  to  J^ioose  from  among  the  ei^ht  goals  for  stu- 
dents listed  belowt  how  would  you  rank  them  according  to  their  importance  in 
your  teaching?    Enter  a  "1"  for  the  moat  important  goal,  a  "2"  for  the  next 
most  important  goal,  and  so  on,  through  "8"  for  the  least  important  goal* 
(FIRST,  RANK  EACH  GOAL.    THEN  MARK  THE  MATCHING  CIRCLE  NEXT  TO  EACH  RANKING.)" 
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about  the  need  to  teach  higher  order  skills  is  to  publish  time  series  and  state 
comparison  data  from  tests  and  subtests  that  tap  higher  order  skills. 


Ir^.ernational  Comparisons  of  Educational  Performance 

New  data  are  becoming  available  comparin^  t..^  academic  performance  of 
students  in  different  countries.  NCES  should  make  sure  that  the  results  of 
these  studies  are  accessible  to  educational  policymakers. 2  A  start  has  been 
made  by  including  data  from  the  Second  International  Mathematics  Study  in 
Indicators  of  Education  Status  and  Trends.  The  following  additional  tables 
of  International  comparison  data  should  be  included  in  one  of  NCES's 
publications: 

•  Mathematics 

-  comparisons  of  performance  disaggregated  by  whether  the  item 
taps  computational  skills  or  problem  solving  ability; 

-  the  performance  of  students  from  each  country  that  participated 
in  the  2nd  International  Mathematics  Study; 

-  the     :anges  in  math  performance  between  the  first  and  second 
mathematics  studies  in  the  U.S.  and  other  countries  disaggre-  ( 
gated  by  subject  and  by  whether  the  item  taps  coirputational 

skills  or  problem  solving. 

•  Science—The  Second  International  Science  Study 

-  comparisons  separately  for  biology,  chemistry,  physics,  earth 
science,  etc.  and  separately  by  whether  the  item  asks  for  a 
fact  or  the  use  of  higher  order  skills; 

-  comparisons  of  the  changes  between  the  1st  and  2nd  Inter- 
national Science  Studies  disaggregated  in  the  same  way 

•  Reading  Comprehension  (Thorndike,  1973) 

•  Literature  (Purses,  1973) 

•  Civic  Education  (Torney,  Oppenheim,  and  Farnen,  1975) 

•  Civic  Attitude:>  {Qppenheim  and  Torney,  1975) 

•  Comparisons  of  Grade  1  and  Grade  5  students  In  the  U.S.,  Japan 
and  Taiwan  (Stevenson,  1983). 

There  is  also  a  need  for  the  publication  of  data  on  the  school  input  and  proc- 
esses and  environmental  variables  that  may  be  accounting  for  the  differences 
between  countries  in  achievement. 
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•  Time  Engaged  in  Study  of  Particular  Subjects  (over  the  course  of 
a  student's  academic  career) 

§  Time  on  Task  (percent  of  time  in  the  school  that  is  actually 
spent  engaged  in  learning)  Stevenson  (1983)  reports  observa- 
tional data  on  classroom  time  on  task  and  parent  child  inter- 
action for  U,S,,  Japan  and  Taiwan, 

f  Time  Spent  Watching  TV 

•  Number  of  BoC/^  Read 

•  Other  Measures  of  Educational  Process  and  Outcomes 

•  Measures  of  the  Economic  Outcomes  of  Schooling 

^  The  role  of  NCES  and  NIE  in  international  comparative  studies  should  be  to 
stimulate  others  (e.g.,  the  appropriate  NIE  Centers)  to  undertake  such  studies 
and  to  provide  grant  support  for  researchers  engaged  in  such  research.  Prob- 
ably the  most  critical  need  at  present  isVor  the  collection  of  internationally 
comparable  time  use  data  for  both  children  (in  and  out  of  school),  parents  and 
other  adults  (Stevenson,  1983;  Stafford  and  Duncan,  1980;  and  Ouster  and 
Stafford,  forthcoming). 

Assessing  Work  Habits  and  Self  Discipline 

High  school  teachers  ranked  "good  work  habits  and  self  discipline**  as 
their  number  two  goal  (see  table  2),  Sixty-eight  percent  of  the  teachers 
reported  it  ranked  among  the  top  three  of  their  teaching  goals.  Only  53  per- 
cent placed  academic  excellence  in  the  top  three  and  43  percent  awarded  top 
three  status  to  personal  growth  and  fulfillment.  .  Amatai  Etzioni  has  said 

Thus,  the  root  problem  is  not  that  millions  of  high  school  gradu- 
ates have  great  difficulties  in  reading,  writing,  and  Vithmetric; 
these  all -too-common  dificiencies  are  consequences  of  insufficient 
self-discipline,  of  inadequate  ability  to  mobilize  self  and  to 
commit.  These  graduates  enter  the  adult  world  twice  handicapped. 
They  suffer  both  from  continued  psychic  underdevelopment  and  from 
the  inadequate  cognitive  preparation  this  underdev^lopmenFTielped 
to  cause.    (Etzioni,  1984;  p.  18) 

When  167  employers  in  the  Los  Angeles  area  were  asked  what  was  the  most  impor- 
tant factor  in  job  success,  63  percent  picked  "good  work  habits,"  23  percent 
picked  "technical  job  skills,"  and  only  14  percent  picked  "linguistic  and 
computing  ability"  (Wilms,  1983). 
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Clearly  it  is  important  to  keep  track  of  how  well  our  scnools  are  devel- 
oping good  work  habits  and  self  discipline*  High  School  and  Beyond  contains  a 
number  of  questions  about  study  habits,  class  cutting,  having  work  done  cn 
time,  tardiness,  attitudes  toward  study  and  beliefs  about  one's  abiiity  to 
control  one's  fate  (self  efficacy)  that  can  be  used  to  assess  character  traits. 
NCES  publications  should  present  some  of  this  data  and  where  possible  make 
comparisons  with  the  Class  of  1972  data.  It  is  important  that  these  items  be 
retained  in  NELS88  and  that  there  be  no  changes  in  wording. 

Self  Efficacy 

The  locus  of  control  or  personal  efficacy  scale  measuring  the  belief  that 
one's  future  is  controlled  by  one's  actions  is  probably  the  best  documented  and 
most  researched  of  the  sociopsychological  scales  contained  In  HSB.  It  probably 
has  a  stronger  coorelation  with  what  Etzioni  Is  referring  to  as  self  discipline 
than  any  other  widely  used  scale.  The  scale  fits  nicely  into  economic  theory, 
for  It  can  be  Interpreted  as  a  measure  of  the  perceived  risk  and  uncertainty 
surrounding  the  consequences  of  one's  actions.  There  is  a  well  documented 
positive  coorelation  between  self  efficacy-believing  that  one  controls  one's 
own  fate—and  labor  market  success.  The  analysis  of  longitudinal  data  contain- 
ing repeated  measures  of  self  efficacy  and  labor  market  outcomes  has  shown  that 
an  Important  part  of  this  association  Is  a  consequence  of  self  efficacy's 
Impact  on  employment  and  wages  rather  than  the  reverse  (Andrlsani,  1978;  Duncan 
and  Morgan,  1979).  Kang  and  Bishop's  (1985)  analysis  of  followup  data  on  HSB 
seniors  found  that  self  efficacy  measured  in  the  senior  year  had  a  larger 
Impact  on  wages  and  employment  In  the  2  years  after  graduation  than  test 
scores,  grades  and  virtually  all  other  school  Items  except  curriculum  and 
employment  during  high  school.  A  one  standard  deviation  rise  In  self  efficacy 
raised  earnings  of  women  by  8.1  percent  and  the  earnings  of  men  by  6.7 
percent. 

Not  surprisingly  self  efficacy  also  has  Important  effects  on  learning. 
Using  a  cross  lagged  design  in  which  senior  test  scores  were  a  function  of 
sophomore  self  efficacy,  deportment,  educational  and  occupational  plans,  self 
esteem  and  performance  on  verbal,  math,  science  and  social  science  tests  and  a 
host  of  other  background  variables,  Hotchkiss  (1984)  found  that  a  one  standard 
deviation  Improvement  In  efficacy  increased  the  verbal  and  civics  test  score  of 
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seniors  by  6  percent  of  a  standard  deviation  and  the  science  test  by  5  percent 
of  a  standard  deviation. 

Hotchkiss  (1984)  has  also  demonstrated  that  schools  have  important  impacts 
on  the  development  of  self  efficacy.  In  analysis  of  KSB  longitudinal  data  in 
which  self  efficacy  as  a  senior  was  modeled  as  a  function  of  self  efficacy  as  a 
sophomore,  a  long  list  of  individual  characteristics  and  a  vector  of  school 
dummies  it  was  found  that  school  dummies  exercised  significant  effects.  The 
multiple  partial  correlation  indexing  the  impact  of  the  school  attended  was 
two-thirds  the  size  of  analogous  multiple  partial  indexing  the  combined  effects 
of  personal  characteristics  and  socioeconomic  background. 

These  results  suggest  that  self  efficacy  deserves  an  important  role  in 
theories  of  learning  and  in  theories  of  occupational  choice  and  career  attain- 
ment. The  results  cited  above  should  be  viewed  only  as  preliminary  forays  into 
the  development  of  such  theories.  Almost  nothing  is  known  about  how  schools 
and  teachers  foster  a  sense  of  self  efficacy.  NELS88  will  be  a  much  better 
data  set  studying  these  processes  than  HSB.3  Consequently  it  is  critical  that 
the  self  efficacy  scale  remains  in  NELS88. 

Measuring  the  Economic  Outcomes  of  Schooling 

Improved  performance  on  tests  of  cognitive  ability  and  greater  achievement 
in  core  academic  subjects  are  not  the  only  goals  of  elementary  and  secondary 
education.  Raising  the  employability  of  youth  is  another  important  goal.  The 
National  Commission  on* bxcellence  in  Education  justified  its  recommendations 
for  reform  in  part  by  the  following: 

Knowledge,  learning,  information,  and  skilled  intelligence  are  the 
new  raw  materials  of  ^'  ternational  commerce  and  are  today  spreading 
throughout  the  world  as  vigorously  as  miracle  drugs,  synthetic 
f ertil izers,  and  blue  jeans  did  earlier.  If  only  to  keep  and 
improve  on  the  slim  competitive  edge  we  still  retain  In  world 
markets,  we  must  dedicate  ourselves  to  the  reform  of  our  educa* 
tional  system  for  the  benefit  of  all— old  and  young  alike,  affluent 
and  poor,  majority  and  minority.  Learning  is  the  indispensable 
investment  required  for  success  in  the  '"information  age"  we  are 
entering,  (p.  7) 

If  schooling  influences  the  productivity  of  the  work  force  as  the  National 
Commission  claims,  then  people  with  greater  amounts  and  higher  quality  educa- 
tion will  be  more  likely  to  find  good  jobs  that  pay  higher  wage  rates. 


Research  on  the  links  between  schooling  and  later  success  in  the  labor 
market  have  found  that  test  scores  have  rather  small  impacts  on  employment  and 
wage  rates  (Bishop,  1985)  a-^d  that  improved  performance  on  standardized  tests 
accounts  for  only  a  small  part  of  schooling's  total  impact  on  labor  market 
success  (Olneck  and  Bills,  1982} •  Vocational  education  has  work  attitudes,  job 
readiness  and  occupational  skills  as  explicit  goals  and  the  time  devoted  to 
developing  these  abilities  may  reduce  the  time  devoted  to  the  traditional 
academic  subjects.  Consequently,  data  on  the  economic  outcomes  of  elerientary 
and  secondary  education  are  essential. 

Experience  with  the  Vocational  Educational  Data  System  suggests  that  the 
schools  probably  cannot  be  expected  to  collect  and  report  data  on  the  economic 
success  of  their  graduates  that  is  comparable  across  schools  and  across  states. 
Data  on  economic  outcomes  must  therefore  be  obtained  from  the  Current  Popula- 
tion Survey,  the  Census,  longitudinal  surveys  like  NLS,  and  organizations  like 
the  College  Placement  Council. 

Survey  of  Salary  Offers  to  Associate  Degree  Recipients 

The  College  Placement  Council  collects  data  from  the  placement  offices  of 
colleges  and  universities  on  the  offers  received  by  B.A.,  H.A.,  and  Ph.D. 
degree  recipients.  Northwestern  University's  Endicott  survey  publishes  similar 
data  obtained  from  a  survey  of  employers.  There  Is  no  comparable  national 
survey  of  salary  offers  to  the  completers  of  two-year  associate  degree  or  one- 
year  certificate  programs.  The  Hiddle  Atlantic  Career  Counseling  Association 
(fiACCA)  has  been  collecting  these  data  on  salary  offers  received  by  recipients 
of  the  Associates  Degree  from  about  forty  2  year  colleges  in  their  six-state 
area  for  the  last  ten  years.  Their  data  cover  about  one-sixth  of  the  nation. 
Data  from  the  VEu  system  is  inadequate  because  the  lag  in  reporting  salaries  is 
too  long  and  because  salary  data  was  not  obtained  separately  for  training 
programs  of  different  length. 

After  getting  support  from  the  American  Associations  of  Community  and 
Junior  Colleges  (AACJC),  MACCA  and  other  interested  groups  NCES  should  contract 
with  the  College  Placement  Council  (or  an  organization  like  the  National  Center 
for  Research  in  Vocational  Education)  to  conduct  a  sa'ary  offer  survey  in  as 
many  2  year  institutions  as  are  willing  to  participate.  Placement  officials  3t 
participating  institutions  would  report  on  the  job  offers  received  by  graduates 
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they  provide  placement  services  to.   The  more  rapidly  such  information  is 
disseminated  the  more  valuable  it  is  so  semiannual  reports  should  be  released. 
Since  the  labor  markets  for  AA  recipi:  »ts  are  .regional  separate  reports  should 
be  published  for  each  of  the  lO  census  regions.  The  cost  of  such  a  data 
collection  effort  would  be  und^r  $100,000. 

New  Tables  Based  on  Existing  CPS  Data:    Time  Series  • 

The  tables  in  the  1983/84  Digest  are  useful  und  should  be  retained.  There 
is  a  need  for  new  tables,  however,  that  provide  comparisons  over  many  years  of 
labor  market  success  (employment,  occupation,  and  earnings)  for  recent  school 
l$%avers.  The  ddia  proposed  would  provide  a  means  of  tracking  whether  the 
decline  in  SAT  scores  and  other  indicators  of  academic  achievement  have  re- 
sulted in  d  parallel  decline  in  the  quality  of  the  jobs  obtaineu  by  recent  high 
school  graduates  and  a  rise  in  their  unemployment  rates.  The  following  tables 
are  recommended. 

1.  Unemployment  rates  and  e.vloynient  to  population  ratios  of  young 
people  who  graduated  from  or  dropped  out  of  high  school  during 

(  the  previous  year  and  are  not  enrolled  in  school  (see  table  C43 

of  Labor  Force  Statistics  Derived  from  the  CPS:  A  Data  Bank, 
1982).  If  possible  separate  scores  for  blacks  and  for  single 
females  should  be  published.  The  table  should  also  contain  an 
unemployment  rate  for  prime  age  (25-55)  males  and  for  prime 
age  females  as  a  point  of  comparison. 

2.  Indicators  of  ihe  quality  of  jobs  obtained  by  recent  high 
school  graduates  and  dropouts.   The  following  are  recommended: 

•  Industrial  Composition 

-  share   of  jobs   in   manufacturing,    mining,  construction, 
^transportation  and  public  utilities' 

-  share  of  jobs  in  government 

-  share  of  jobs  in  wholesale  retail  or  service 

•  Qccupe^ional  Composition 

-  share  of  jobs  in  laborers  or  service  occupations 
*-  share  of  jobs  in  operative  occupations 

-  share  of  jobs  in  clerical  occupations 
share  of  jobs  in  sales  occupations 

These  data  should  be  presented  both  for  those  who  graduated  and 
those  who  dropped  out  of  high  school  the  previous  year,  and  for 
all  18-24  year  old  high  school  graduates  not  enrolled  in  col- 
lege and  for  ^all  18-24  year  old  high  school  di  p  outs. 

3*   Average  yearly  earnings  of  young  people  not  enrolled  in  school 
(  categor^>^.d  by  educational  attainment.  Three  age  groups  should 
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be  reported:  18-24,  25-34  and  35-65.  The  educational  attain- 
ment categories  might  be  0-11,  12,  13-15,  16  and  17+.  Separate 
data  should  be  provided  by  sex  and  for  full  time  ful  1  year 
workers.  In  order  to  accentuate  the  comparisons  across  educa- 
tional levels,  the  information  could  be  presented  as  ratios  to 
the  earnings  of  high  school  graduates  (real  dollar  amounts  of 
earnings  would  be  presented  only  for  high  school  graduates). 
Tabulating  these  data  for  recent  school  leavers  and  comparing 
it  to  average  weekly  earnings  of  other  groups  will  provide  a 
measure  of  the  relative  labor  market  success  of  those  who  have 
recently  completed  their  schooling. 

4.    Unemployment  rates  for  people  categorized  by  education  and  by 
age  (e.g.,  18-24  and  25-65). 

Data  on  the  labor  market  behavior  of  students  is  also  important,  though 
not  as  critical  as  data  on  recent  school  leavers.  High  school  and  college 
students  spend  a  great  deal  of  time  working. 4  These  jobs  have  both  good  and 
bad  effects  on  educational  outcomes.  They  help  finance  college  but  they  do  so 
by  often  reducing  the  time  available  for  study. 

Improvements  in  CPS  Data 

NCES  can  greatly  improve  the  usefulness  and  timeline ^  of  data  from  the 
Current  Population  Survey's  (CPS)  October  supplement  on  attendance  and  comple- 
tion of  schooling  by  arranging  for  the  addition  of  the  following  questions: 5 

•  usual  weekly  earnings  (same  wording  as  in  the  January  and  Hay 
supplements) 

•  highest  degree  or  credential  received 

•  whether  school  from  which  highest  degree  received  was  a  4  year 
college,  2  year  junior  or  community  college,  or  technical 
institute 

•  whether  the  school  most  recently  attended  (or  from  winch  highest 
degree  was  received)  was  public.  Catholic,  other  religiously 
oriented  private  or  sectarian  private 

•  the  students  major  or  concentration  at  that  school  (for  high 
school  the  categories  might  be  the  same  as  those  in  question  2  of 
the  HSB  senior  questionnaire,  greater  detail  would  be  obtained 
from  those  with  some  college  or  a  college  degree) 

•  whether  the  individual  received  special  education  services  in 
elementary  or  secondary  school  and  the  type  of  handicap 
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•  state  in  which  high  school  was  located 

•  state  in  which  college  was  located 

The  addition  of  these  8  questions  would  greatly  improve  our  ability  to  track 
changes  over  time  in  the  economic  returns  to  various  types  of  schooling  and  to 
compare  t>e  effectiveness  of  schooling  in  different  parts  of  the  country.  This 
small  add'tior.  to  only  one  month  of  the  CPS  would  go  a  long  way  toward  meeting 
the  Congressional ly  mandated  requirements  for  data  on  the  outcomes  of 
vocational  education. 

T'le  monetary  returns  to  college  attendance  end  to  majoring  in  specific 
fields  vary  over  time  due  to  shifts  in  demand  and  supply  for  the  skills  taught 
in  these  schools  (Freeman,  1971 ;  1971a;  1971b) .  The  monetary  benefits  of 
completing  high  school  and  of  receiving  different  types  of  high  school  prepara- 
tion also  vary  over  time.  Estimates  of  the  impact  of  vocational  education  of 
the  earnings  of  1980  high  school  graduates  (HSB)  are  considerably  more  positive 
than  estimates  In  earlier  cohorts  (such  as  Class  of  1972,  the  NLS  Young  Hens 
survey,  and  the  NLS  Youth  Cohort)  (Kang  and  Bishop,  1985;  Heyer,  1982;  Daymont 

^  and  Rumberger,  1982),  The  change  could  be  a  result  of  Improvements  in  the 

quality  of  vocational  offerings  but  It  might  also  have  been  e  consequence  of 
the  unique  economic  environment  that  greeted  1980's  high  school  graduates* 
Data  from  repeated  CPS  surveys  are  -necessary  If  we  are  to  distinguish  long  term 
trends  In  the  return  to  vocational  or  other  particular  types  of  education  from 
short  run  shifts  due  to  the  business  cycle.  The  CPS  obtains  earnings  Informa- 
tion on  a  much  larger  sample  (over  7^^,000  households)  than  other  surveys 
available  for  studying  the  Impacts  of  curriculum. and  nrlvate  or  public  control 
of  Institution  (e.g.,  NELS  and  NLS)  and  simultaneous  analysis  of  data  from  more 
than  one  year  Increases  the  sample  size  even  further.  This  feature  means  that 
CPS  data  can  provide  reasonably  reliable  estimates  of  economic  outcomes  for 
smaller  subgroups  (e.g.,  male  graduates  of  Catholic  high  schools  who  did  not  go 
on  to  college  or  female  vocational  education  students  In  nontraditlonal  occupa- 
tions). The  cost  of  such  a  supplement  would  be  about  $50,000  for  data  collec- 
tion, another  $150,000  for  programming,  analysis  and  writing  a  report. 6  For 
this  rather  modest  Investment  we  would  have  data  on  the  economic  benefits  of 
different  types  of  schooling  for  more  than  100,000  working  adults.  The  cost 

,  would  be  under  2  dollars  per  person. 
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It  IS  recognized  that  the  classification  of  individuals  by  their  majors  or 
field  of  study  would  not  be  as  reliable  as  the  data  that  could  be  obtained  from 
transcripts.  Other  longitudinal  data  sets  wiiich  merge  foUowup  dala  on  eco- 
nomic outcomes  with  high  school  and  college  transcript  informdtion  and  baseline 
measures  of  aptitude,  academic  achievement,  and  career  plans  would  still  be 
needed.  These  data  sets  cost  at  least  200  .dollars  per  observation,  however* 
To  be  useful  there  must  be  data  on  comparison  groups  (i.e.,  those  who  do  not 
take  vocational  courses)  as  well  as  on  those  who  complete  the  program  that  is 
the  object  of  interest.  Longitudinal  studies  like  NELS88  cannot  be  conducted 
on  the  scale  or  with  the  frequency  that  would  be  needed  to  construct  a  reliable 
time  series,  to  make  comparisons  between  the  larger  states  or  to  provide  esti- 
mates of  economic  outcomes  for  subsets  of  the  population.  Consequently,  impor- 
tant as  the  longitudinal  surveys  are  for  analyzing  the  effects  of  various 
educational  programs  the  augmented  CPS  would  be  a  useful  supplement. 

Comparing  Economic  Outcomes  in  Different  States 

Indicators  of  economic  outcomes  for  specific  states  are  also  needed. 7  { 
Differing  economic  climates  need  to  be  taken  into  account,  so  tables  must  be 
structured  so  as  to  highlight  statistics  that  compare  the  labor  market  success 
of  groups  with  differing  amounts  or  kinds  of  education  but  subject  to  the  same 
economic  climate.  The  greatest  need  is  for  tables  which  describe  how  particu- 
lar increases  in  educational  achievement  (e.g.,  graduation  from  high  school, 
completing  some  college,  completing  a  four  year  degree)  improves  one's  labor 
market  success  ip  that  state.  Since  most  people  find  employment  in  the  state 
where  they  complete  their  education,  these  tables  will  provide  a  measure  (an 
imperfect  one  to  be  sure)  of  the  economic  payoff  to  that  level  of  schooling  in 
that  state— something  that  should  be  correlated  both  with  the  quality  and  the 
labor  market  relevance  of  that  level  of  schooling  in  that  state. 8  Since  the 
source  of  data  for  this  would  be  the  1980  Census,  the  publication  of  this  deta 
would  not  need  to  be  repeated  each  year.  The  tables  that  should  be  developed 
and  made  more  accessible  to  state  policy  makers  are  the  following: 

•  Earnings  of  different  age  groups  (18-19,  20-21,  22-24,  25-29, 
30-34,  35-44,  45-54,  55-64,  65^)  by  years  of  schooling  completed 
by  sex,  by  minority  status  and  for  all  workers  and  full  time  full 
year  workers.    (Available  in  Table  237  of  Detailed  Population 
Characteristics  of  the  1980  Census.)  The  focus  of  the  table 
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should  be  the  earning  ratios  for  people  with  differing  educa- 
tional attainment. 

•  Occupational  and  industrial  distribution  of  people  categorized  by 
educational  attainrrent,  age,  sex,  and  minority  status. 

•  Unemployment  rates  and  employment  to  population  ratios  by  people 
categorized  by  educational  attainment,  age,  sex,  and  minority 
status. 

The  usefulness  of  the  1990  Census  for  such  comparisons  would  be  greatly 
improved  if  questions  were  added  on  the  field  of  study  in  high  school  and 
college,  degrees  received,  state  in  which  the  individual  attended  high  school, 
and  state  in  which  the  individual  attended  college. 
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IV.    NEEO  FOR  DATA  SETS  FOR  ESTIMATING  CAL'^V. 
MODELS  OF  EDUCATIONAL  IMPROVEMENT 


Probably  the  least  controversial  conclusion  of  effective  schools  research 
is  that  schools  are  institutions  that  have  cultures  (norms  and  expectations 
that  students  and  teachers  hold  in  coimnon)  which  have  powerful  effects  on  how 
teachers  teach  and  what  students  learn*  Many  of  the  most  important  outcomes  of 
schooling—verbal  ability,  reasoning  ability,  self  discipline,  character, 
employability,  ability  to  work  as  part  of  a  team--are  the  result  of  the  entire 
school  experience  and  not  something  learned  in  particular  courses.  There  is  a 
need,  therefore,  for  research  that  takes  the  school  as  a  unit  of  analysis.  Two 
very  important  issues  need  to  be  addressed. 

f  What  is  it  about  a  school  that  causes  students  to  learn  more,  to 
develop  better  character,  or  become  more  employable?  Associa- 
tions have  been  found  between  school  climate  and  learning  and 
lists  of  school  effectiveness  characteristics  have  been  gener- 
ated. The  lists  seem  reasonable  but  the  research  that  has  gener- 
ated them  suffers  from  serious  methodological  weaknesses  (Purkey 
and  Smith,  1982). 

•  How  are  effective  schools  created?  How  does  a  school's  ethos 
evolve?  Since  the  school  characteristics  that  are  associated 
with  school  effectiveness  are  not  under  the  direct  control  of  a 
principal  or  school  board,  we  need  to  describe  the  relationship 
between  administrative  actions  and  school  climate. 

Data  for  Studies  of  School  Impacts  on  Learning, 
Character  Development  and  EmployabillTy 

The  first  Issue  can  be  addressed  if  a  dataset  has  the  following  features 

1.  Longitudinal  data  on  students  while  they  are  at  school. 

-  achievement  test  scores  at  various  points  In  time 

-  aptitude  test  scores 

-  family  background 

-  educational  and  occupational  plans 

-  work  habits,  study  habits,  self  discipline  and  self  efficacy 

-  courses  taken  from  transcripts 

-  career  goals 

2.  Longitudinal  daua  on  students  after  they  leave  !.igh  school. 

-  college  attendance  and  completion 

-  employment,  wages,   on-the-job  training,   productivity,  job 
search  and  turnover 
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-  crime  and  drug/alcohol  abuse 

-  career  goals,  locus  of  control  and  self  esteem 

-  job  characteristics   (e.g.,  cognitive  complexity,  autonomy 
status] 

3.   Comprehensive  description  of  the  character  of  the  school  (in- 
puts, processes,  climate]  while  the  student  was  at  the  school 

-  interviews  with  principal 

-  interviews  of  teachers  and  other  staff 

-  aggregated  responses  of  students  describing  school  climate 

The  National  Educational  Longitudinal  Survey  of  1988  described  in  the 
February  1985  NELS88  Position  Papers  (Longitudinal  Studies  Branch,  NCES  1985) 
has  the  three  features  necessary  to  support  studies  of  how  schools  effect  the 
learning,  character  development  and  labor  market  success  of  high  school  stu- 
dents. Below  Is  a  list  6f  comments  on  specific  aspects  of  the  proposed 
design. 

•  Substituting  data  collection  on  entering  college  students  for 
data  collection  on  graduating  high  school  seniors  is  recommended, 
for  it  makes  study  of  college  climate  and  teaching  feasible.  A 
survey  of  college  teachers  should  be  a  part  of  the  NELS88. 

( 

•  An  attempt  should  be  made  to  follow  up  all  of  the  NELS88  students 
after  they  leave  school  not  just  a  saiiipTe,  If  cost  is  a  deter- 
rent, less  frequent  followups  (e.g.,  at  3  year  intervals  rather 
than  2  year  intervals]  would  be  acceptable.  Another  alternative 
would  be  to  drop  the  followup  of  recent  college  graduates  and  use 
followups  of  HSB  and  NELS88  instead. 

•  Many  of  the  most  important  effects  of  a  quality  education  do  not 
appear  until  many  years  later.  Followup  should  consequently  be 
continued  for  20  years.  Once  the  cohort  has  reached  the  age  of 
24  the  frequency  of  followup  might  be  shifted  to  once  every  5 
years. 

•  School  records  should  be  accessed  to  obtain 

-  courses  taken 

-  grades  in  specific  courses 

*  test  score  data  on  all  widely  used  achievement,  aptitude  and 
minimum  competency  tests  taken  by  the  student  for  as  far  back 
in  the  students  educational  career  as  possible. 

-  receipt  of  special  education  service  and  nature  of  disability 

*  absenteeism 

-  tardiness 
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•  The  teachers  who  are  surveyed  need  to  be  selected  in  a  manner 
which  allows  researchers  to  generalize  either  to  a  definable 
subset  of  secondary  school  teachers  or  to  the  entire  population. 
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•  Teacher  assessments  of  individual  students  who  are  in  the  HSB 
survey  are  quite  valuable.  The  checklist  the  teachers  complete 
should  include  an  item  on  locus  of  control. 

•  Consideration  should  be  given  to  developing  a  data  set  which 
matches  students  to  particular  teachers.  In  a  subset  of  schools 
arrangements  could  be  made  to  track  which  teachers  each  student 
has  over  the  course  of  high  school.  In  these  schools  all  teach- 
ers  would  be  surveyed  and  the  size  of  the  student  sample  would  be 
Increased. 

•  The  principal  and  guidance  counselor  should  be  asked  whether  thoy 
respond  to  employer  requests  for  t^nscript  information  under  two 
different  circumstances;  the  student  has  signed  a  release  form, 
the  student  has  not  signed  a  release  form.  Nationwide  Insurance 
of  Columbus  Ohio  sent  more  than  1,200  requests  for  transcript 
information  with  student  releases  to  local  high  schools  in  1982 
and  received  only  93  responses.  Not  responding  to  such  requests 
when  former  students  have  signed  a  release  Is  a  violation  of  the 
Family  Educational  Rights  and  Privacy  Act  of  1974. 

Sophomore  Baseline  Questionnaire 

•  The  locus  of  control  (self  efficacy)  scale  should  be  retained. 

•  Some  students  spend  little  time  on  homework  because  they  find  it 
easy  to  accomplish  quickly.  Others  spend  little  time  because 
they  do  not  finish  the  assignments.  Therefore  it  is  important  to 
ask  what  proportion  of  his/her  homework  assignments  are  completed 
and  handed  in  on  time. 

•  Drug  and  alcohol  abuse  Is  a  serious  barrier  to  learning  and 
questions  on  these  matters  should  receive  high  priority.  I  do 
not  agree  that  these  questions  are  too  sensitive  to  ask  in  the 
sophomore  survey.  The  questionnaire  currently  asks  about  being 
in  trouble  with  the  law. 

•  The  proposed  addition  of  new  questions  on  disciplinary  problems 
is  a  good  Idea. 

•  The  question  about  when  was  the  last  time  you  worked  (BB021)  is 
not  worded  well:  A  question  asking  what  proportion  of  the  school 
year  the  student  has  been  working  is  suggested  to  replace  it. 

Employment  Data  in  Followups  (applies  to  NLS72  and  HSB  as  well) 

•  Continuous  time  employment  histories  as  in  HSB  followups  are  very 
valuable  and  should  be  retained.  The  number  of  different  jobs 
should  not  be  limited  to  4,  however. 

•  The  question  on  how  you  found  this  Job  is  very  valuable  and  it 
should  be  retained.  There  is  evidence  that  for  vocational  stu^ 
dents'  Informal  recommendations  by  teachers  are  more  effective 
than  school  placemenc  services  In  finding  Jobs  for  students  and 
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graduates  (McKinney  et  al.  1980).  A  distinction  between  the  two 
should  be  drawn  by  adding  "Through  a  fornier  teacher"  to  the  list 
of  alternatives.  Finding  a  job  through  a  friend  or  relative  who 
works  at  the  firm  has  an  especially  strong  tendency  to  reduce 
turnover.  The  distinction  can  be  drawn  by  using  the  following 
response  categories  "through  a  relative  who  worked  at  the  firm, 
through  a  relative  who  did  not  work  at  the  firm,  through  a  friend 
who  worked  at  the  firm,  and  through  a  friend  who  did  not  work  at 
the  firm." 

f  The  question  on  why  you  left  the  job  should  be  retained,  but 
involuntary  terminations  need  to  be  disaggregated  into: 

-  fired 

-  temporary  or  seasonal  job  . 

-  lay  off  not  anticipated  when  hired. 

•  The  question  on  training  (51A-D  and  52A-E  of  Second  Followup  of 
Seniors)  should  be  asked  for  as  nany  jobs  as  possible  and 
especially  for  the  first  few  jobs  after  leaving  school.  If  a 
tradeoff  Is  necessary,  reduce  thf  number  of  job  satisfaction 
questions. 

•  The  unemployment  section  Is  good  and  should  be  retained.  It 
should  Include  a  question  about  receipt  of  unemployment  insur-* 
ance.  A  separate  section  should  be  developed  to  ask  about  the 
search  process  that  led  to  the  first  job  after  leaving  school  the 
last  time. 

•  Questions  on  tardiness,  absenteeism  and  ""goofing  off**  on  the  job 
that  parallel  similar  questions  about  school  behavior  would  be 
desirable. 

•  Wage  rates  do  not  fully  capture  the  productivity  impacts  of  a 
good  education.  Studies  based  on  absolute  measures  or  produc- 
tivity of  incumbents  In  particular  jobs  that  pay  the  same  wage  to 
everyone  with  equal  tenure  find  It  has  a  coefficient  of  variation 
of  20  percent  (Schmidt  and  Hunter ,  1983)..  The  respondent  should 
be  asked  to  make  a  self-assessment  of  their  effort  c  n  the  job  and 
of  their  productivity.  Question  wording  might  be  something  like: 
"Relative  to  the  other  employees  at  the  firm,  how  much  harder  or 
less  hard  did  you  work?  How  do  you  think  your  supervisor  as- 
sessed your  productivity  relative  to  the  other  employees  doing 
similar  work?^  If  a  tradeoff  Is  necessary  reduce  the  number 
questions  of  satisfaction  and  probabllles  of  taking  particular 
kinds  of  jobs. 

•  Consideration  should  be  given  to  obtaining  permission  from  stu- 
dents to  speak  to  their  employer  or  supervisor  and  then  asking 
the  supervisor  for  an  assessment  of  huw  the  Individual's  produc- 
tivity and  capabilities  compare  with  other  employees. 
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Data  for  Studies  of  School  Improvement 

Studies  of  how  schools  evolve  require  data  sets  with  repeated  measures  of 
school  climate  and  school  processes.  Such  deta  sets  are  very  expensive  to 
create,  however,  because  the  key  climate  and  process  variables  cannot  be  mea- 
sured without  interviewing  large  samples  of  teachers  and  students  at  each 
school.  A  recent  survey  of  10,360  teachers  which  measured  school  climate  and 
processes  at  500  high  schools  cost  more  than  $200,000  to  conduct.  Longitudinal 
data  on  school  climate  and  process  can  be  made  available  at  no  additional  cost 
simply  by  returning  to  these  500  schools  in  the  NELS88  and  repeating  some  of 
the  same  questions  in  the  survey  of  teachers. 

Data  for  Studies  of  Learning  in  Elementary 
Schools  and  Junior  High  Schools 

Longitudinal  data  sets  that  start  when  the  child  is  very  young  and  follow 
him/her  all  the  way  through  school  and  into  the  labor  market  would  make  pos- 
sible a  number  of  very  valuable  studies: 

•  Long  term  effects  of  early  childhood  education  and  types  of  ( 
special  education  services 

•  Elementary  school  effectiveness 

•  Junior  high  school  effect'veness 

•  Retention  in  high  school  through  the  10th  grade.  Host  dropouts 
leave  school  before  the  end  of  their  sophomore  year  and  so  are 
not  part  of  the  NELS88  baseline. 

•  Evolution  of  ^career  awareness  and  a<;p1rat1ons  prior  to  10th 
grade. 

Consideration  should  therefore  be  given  to,  starting  in  1988,  a  longi- 
tudinal survey  of  second  graders  and  their  parents  in  a  sample  of  the  elemen- 
tary schools  that  feed  into  the  high  schools  selected  for  NELS88.  The  parent 
child  data  would  then  be  merged  with  school  records  on  grades  and  aptitude  and 
achievement  test  scores  and  surveys  of  the  principals  and  teachers  of  the 
school  attended.  These  students  would  then  be  resurveyed  in  1992  and  1996  and 
serve  as  the  sophomore  cohort  of  NELS96. 

Another  way  a  longitudinal  data  set  might  be  developed  would  be  to  under- 
take a  followup  of  the  1st  through  3rd  grade  children  who  participated  in  the 
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Sustaining  Effects  Study  in  1975  through  1978.  An  additional  requirement  would 
be  surveys  of  the  principals  and  teachers  in  the  elementary  and  secondary 
schools  attended  by  these  students  and  the  development  of  a  median ism  for 
matching  each  student  to  the  teachers  that  he/she  had.  Even  if  no  further 
aug..«jntation  of  the  Sustaining  Effects  data  is  planned  there  would  be  sig- 
nificant benefits  to  making  a  well  documented  version  of  the  data  set  more 
widely  available  through  NCES. 
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FOOTNOTES 


1.  Awarding  a  high  school  diploma  to  a  student  who  cannot  read  or  write,  may 
make  that  individual  better  off  but  it  depreciates  tne  value  of  the  diploma  for 
everyone  else  and  lowers  the  efficiency  of  the  process  which  matches  individ- 
uals to  jobs. 

2.  The  lEA  data  comparing  the  U.S.  and  other  countries  first  became  available 
in  the  early  70s.  To  my  knowledge  these  data  never  appeared  in  an  NCES  pub- 
lication until  after  the  report  of  the  National  Commission  on  Excellence  in 
Education.  If  these  statistics  had  been  appearing  regularly  in  publications 
like  The  Condition  of  Education,  the  nation's  attention  might  have  been  di- 
rect ea"To"TFFTro5TerF"or"3err^      standards  much  sooner  than  it  was. 

3.  NELS88  is  a  better  vehicle  for  studing  the  effects  of  school  process  and 
climate  on  student  outcomes  because  the  school  process  and  climate  variables 
will  be  measured  when  the  students  are  sophomores  rather  than  2  years  after 
graduation  as  in  the  case  of  HSB. 

4.  High  school  juniors  and  seniors  average  more  than  10  hours  a  week  in  paid 
employment  during  the  school  year.  Time  engaged  in  a  learning  activity  aver- 
aged under  20  hours  (Bishop,  1985;  p.  9). 

5.  An  alternative  might  be  to  add  the  questions  about  school  background  to  e 
month  that  already  has  the  weekly  earnings  data  such  as  May  or  January.  The 
March  Survey  is  already  too  crowded  to  be  considered  for  this  pur-^ose. 

6.  The  source  of  these  estimates  is  an  off  the  record  conversation  with  a 
former  Census  Bureau  staff  member). 

7.  At  present  the  Digest  of  Education- Statistics  does  not  contain  such  data 
(see  table  1). 

8.  The  CPS  question  on  state  In  which  one  received  one's  high  school  educa- 
tion described  in  the  previous  section  would  allow  the  construction  of  similar 
tables  using  CPS  data  that  would  assign  migrants  to  the  state  where  they  re- 
ceived their  education  rather  than  their  state  of  residence. 
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MONITORING  THE  CONDITION  OF  EDUCATION 

by  Alphonse  Buccino 
The  University  of  Georgia 


Executive  Summary 

This  paper  responds  to  the  NOES  invitation  to  participate 
in  the  process  of  redesigning  the  elementary  and  secondary 
education  data  program.    The  purpose  of  NOES  is  seen  in  terms 
of  monitoring  the  adequacy  of  the  Nation's  education  enterprise 
in  meeting  individual  and  societal  needs  and  expectations.  To 
do  thisr  a  sense  of  mission  for  the  enterprise  is  essential- 
This  mission  is  proposed  in  terms  of  producing  leaders, 
technical  specialists,  and  informed  citizens,  and  for 
addressing  equity  concerns  and  optimal  use  of  talent. 

A  frfiunework  for  monitoring  the  education  enterprise  is 
described  consisting  of  five  categories  of  variables.  These 
categories  are:  -  outcomes,  participation,  resources^  impact, 
and  purposes .    Each  of  these  categories  is  elaborated  and 
defined.    An  argument  is  made  that  outcomes  is  the  key 
category.    Additionally,  a  caveat  is  presented  in  that  the 
framework  comprises  an  input/output  model.    Professionals  in 
education  typically  dislike  such  models  and  prefer  more 
expressive  ones.    Nevertheless,  the  input/output  model  is  the 
only  model  that  is  well-defined.    Moreover,  it  is  understood 
and  preferred  by  policy  and  decision  makers  and  the  public. 

Suggestions  are  then  made  for  data  sets  within  each  of  the 
categories*    Especially  notable  data  sets  discussed  are  the 
following  ones:  student  achievement  data  (NAEP);  course 
enrollment  data;  data  regarding  teacher  quality  as  well  as 
quantity;  and  data  regarding  curriculum  content  (e.g.  commonly 
used  textbooks). 

Additional  consideration  is  suggested  for  information  in 
such  special  areas  as:  international  comparisons;  informal, 
out-of -school  education;  and  technology  in  education.    It  is 
strongly  recommended  that  NCES  develop  guidelines  to  facilitate 
compatibility  among  data  c  llected  at  the  state  level  and  by 
other  institutions  and  agencies.    Additionally,  special 
attention  Is  urged  for  the  encouragement  and  support  of 
interpretations  of  data  from  NCES  and  other  sources. 

The  paper  concludes  with  a  discussion  of  why  data 
comparison  is  especially  important.    A  focus  on  outcomes  is 
urged,  with  other  variables  tightly  linked  to  outcomes. 
Comparisons  should  be  among  states,  within  states,  and  among 
nations . 
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Mission  of  the  Education  System 

The  elementary  and  secondary  data  program  of  the  National 
Center  for  Education  Statistics  (NCES)  should  be  designed  to 
monitor  the  adequacy  of  the  Nation's  education  enterprise  in 
meeting  individual  and  societal  needs  and  expectations.    To  do 
this,  a  sense  of  mission  for  the  enterprise  is  essential.  One 
aspect  of  such  a  mission  concerns  the  scope  and  level  of 
knowledge  and  skill  needed  for  the  Jobs  of  today  and  tomorrow. 
This  refers  to  the  adequacy  of  the  education  enterprise  for 
maintaining  the  health  and  vitality  of  the  U.S.  economy.    Two  , 
groups  of  particular  interest  in  this  regard  are  leaders  and  ^ 
technical  specialists.    The  significance  of  this  aspect  of  the 
mission  is  reflected  in  such  national  reports  as  A  Nation  At 
Risk  (National  Commission  on  Excellence  in  Education,  1983)  and 
Educating  Americans  for  the  21st  Century  (National  Science 
Board  Commission  on  Precollege  Education  in  Mathematics, 
Science  and  Technology,  1983). 

But  education  can  contribute  to  the  national  welfare 
through  the  preparation  of  leaders  and  technical  specialists 
only  to  the  degree  that  their  work  is  understood  by  citizens 
and  can  be  assimilated  into  our  social  structures. 
Accordingly,  our  education  system  must  also  produce  informed 
citizens. 

Additionally,  education  has  long  been  the  route  by  which 
upward  mobility  has  been  achieved  by  disadvantaged  groups  in 
our  society.    This  has  not  changed.    Thus,  our  education  system 
must  be  instnanental  in  aiding  those  who  have  been  excluded 
fror.  full  realization  of  their  capabilities.    This  requirement 
for  the  education  enterprise  is  stressed  both  for  reasons  of 
equity  and  to  increase  the  size  of  pool  of  talent  from  which 
future  leaders  and  technical  specialists  are  drawn. 

The  inclusion  of  informed  citizens  and  equity  concerns  in 
the  foregoing  is  a  reaffirmation  of  the  Jeffersonian  principle 
that  an  enlightened  citizenry  is  the  only  safe  repository  of 
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control  over  the  ultimate  processes  of  society.    This  principle 
is  clearly  articulated  in  the  reports  of  the  National 
Commission  on  Excellence  and  the  National  Science  Board 
Commission  that  were  referred  to  earlier*    Today ,  the  issue  of 
the  adequacy  of  the  education  enterprise  in  addressing  these 
purposes  refers  to  the  goal  of  a  fully  educated  citizenry,  not 
just  a  long  schooled  one  (Resnick  and  Resnick,  1985) • 

In  summary r  a  program  for  monitoring  the  education  system 
of  the  U.S.  must  address  the  adequacy  of  the  system  for 
producing  leaders r  technical  specialists r  and  informed  citizens 
and  for  addressing  equity  concerns  and  optimal  use  of  talent • 
Included  within  the  definition  of  adequacy  are  considerations 
regarding  numbers  of  students r  cost-effectiveness,  and  the 
general  health  and  capability  of  the  system  itself. 

A  Monitoring  Framework 

-  There  are  many  ways  to  describe  the  education  system  and 
assess  its  adequacy.    To  help  focus  in  on  an  approach,  it  is 
useful  to  consider  categories  of  variables.    The  discussion 
here  is  an  adaptation  of  the  framework  set  forth  by  Dennis 
Cooler  (1975).    This  organizing  framework  for  the  development  . 
of  data  or  data  series  consists  of  five  categories. 

^  The  first  category  we  present  is  outcomes.    This  has  two 

broad  components:  tests  ^^nd  credentials.    Tests  provide 
measures  of  what  people  know  and  what  intellectual  and 
performance  skills  they  possess.    Use  and  misuse  of  tests  is  a 
matter  of  considerable  controversy.    Accordingly,  the  use  of 
tests  and  test  data  requixes  a  balanced  and  thoughtful 
scrutiny.    This  issue  is  further  discussed  later  in  the  paper. 

The  other  component  in  this  category,  credentials, 
concerns  such  things  as  diplomas,  certificates,  and  degrees 
awarded  by  the  education  enterprise  for  successful  completion 
of  programs  or  curricula.    Patterns  of  credential  earning  also 
provide  measures  of  outcomes  of  education. 

I  begin  with  the  outcome  category  because  I  believe  it  is 
the  most  important  and  should  constitute  the  focus  of  any 
program  to  monitor  the  education  system.    Moreover,  the 
categories  below  should  be  developed  in  such  a  way  as  to  link 
tightly  to  outcomes. 

A  second  category  is  participation.    This  category 
addresses  the  question:  Who  does  education  serve?    It  concerns 
how  many  and  what  kinds  of  people  take  part  in  education  and 
the  form  it  takes.    Included  here  are  such  elements  as 
retention  rates  of  education  programs  and  patterns  of 
curricular  interests  of  students.    My  experience  is  that  this 
(  category  is  second  in  Importance  only  to  outcomes  and  is 

^  essential  to  an  understanding  of  outcome  information. 


A  third  category  is  the  resources  available  to  education. 
This  may  include  personnel  acting  as  teachers,  institutions 
offering  courses  of  instruction,  or  tax  dollars.    Resources  may 
take  the  form  of  capital,  personnel,  or  teaching  materials.  It 
may  also  include  such  things  as  type.'  of  educational  programs 
offered,  curricula,  and  the  amount  of  time  spent  on  them. 

Resources  available  to  education  may  well  include 
educational  research  and  development  in  that  these  contribute 
to  improving  education.    Thus,  measurement  of  support  for 
educational  R  &  D  or  of  information  portraying  the  scope  and 
condition  of  the  educational  R  6  D  enterprise  should  be 
considered  in  this  category. 

A  fourth  category  of  the  proposed  organizing  framework 
concerns  impact.    This  addresses  the  longer  range  effects  of 
education  extending  beyond  outcomes  as  discussed  earlier. 
Impact  addresses  such  questions  as:  To  what  uses  do  individuals 
put  their  education?    What  happens  to  individuals  who 
participate  in  education?    There  are  three  types  of 
relationships  one  might  consider.    One  is  the  relationships 
among  education,  work,  and  inc<»ne«    Another  type  concerns  such 
things  as  concepts  of  self -worth,  participation  in  community 
affairs,  and  life  styles.    A  third  type  might  concern  the 
impact  of  education  on  general  social,  cultural,  and  economic 
affairs* 

The  fifth  and  final  category  might  be  labeled  purposes. 
This  category  would  include  data  or  data  sets  that  provide 
descriptions  of  the  needs  of  the  education  enterprise  and 
expectations  held  for  it.    From  these,  of  course,  a  general 
sense  of  mission  for  education  can  be  derived  ?ind  a  set  of 
purposes  education  is  expected  to  serve.    The  preceding  section 
offered  one  vision  of  the  mission  of  the  U.S.  education 
enterprise.    This  category  is  explicitly  included  because  there 
is  a  tendency  to  take  purposes  for  granted.    While  a  great  deal 
of  effort  need  not  be  devoted  to  this  category,  it  is 
nevertheless  useful  to  include  in  order  to  assure  common 
understanding. _ 

A  caveat  is  in  order  about  the  framework  presented  here. 
Each  age  and  culture  defines  education  in  terms  of  the  meanings 
it  gives  to  teaching  and  learning,  and  these  meanings  arise  in 
part  from  the  metaphors  used  to  characterize  teachers  and 
learners.    In  the  ancient  world,  one  of  the  defining 
technologies  was  the  potter *s  wheel  with  the  student's  mind; 
the  analog  of  clay  in  the  hands  of  the  reacher.    Later  the 
defining  technology  was  the  mechanical  clock  (Kilpatrick, 
1985).    Other  metaphors  have  likened  education  to  agriculture 
or  young  students*  minds  to  blank  slates  or  empty  vessels. 
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The  framework  presented  above  quite  clearly  embodies  an 
economic  metaphor  or  input/output  model.    A  pejorative 
description  is  the  "factory  metaphor."    One  should  realize  that 
educational  professionals  and  practitioners  generally  dislike 
this  kind  of  'metaphor  and  prefer  more  expressive  ones  that  they 
believe  more  accurately  reflect  the  subtlety  of  education. 

However,  there  is  the  problem  of  going  from  metaphor  to 
categories.    I  am  not  aware  of  any  effort  that  completes  an 
alternative  metaphor  as  well  as  Cooler  has  rounded  out  the 
economic  model.    Moreover ,  the  model  presented  here  is 
recognizabla  by  the  general  public  and  by  decision  and  policy 
makers  outside  of  education  and  probably  preferred  by  them.  As 
indicated  earlier,  outcomes  is  the  key  category.    This  view 
expresses  strong  agreement  with  Cooke,  Ginsburg,  &  Smith 
(1985).'  There  has  always  been  a  great  deal  of  information 
(relatively  speaking)  about  the  inputs  to  education,  but 
outcome  information  has  been  scarce  and  inaccurate.    One  of  the 
most  significant  features  of  the  current  wave  of  public  concern 
about  education  is  a  shift  in  focus  from  inputs  to  outcomes. 

Suggestions  for  Data  Sets 

Rather  than  try  to  provide  a  complete  list  of  data  rets 
that  might  be  included  in  each  of  the  categories  of  our 
framework,  I  will  focus  on  just  a  few  that  either  are 
particularly  important  or  represent  something  unusual  in  terms 
of  what  NCES  has  done  in  the  past. 

Outcome  information  is  the  key  to  any  effective  system  for 
monitoring  the  condition  of  education  in  the  U.S.    In  this 
regard,  the  issues  raised  by  Cooke,  Ginsburg,  and  Smith  (1985) 
are  germane.  -There  is  considerable  interest  in  state-by-state 
comparisons,  but  the  current  information  base  for  making  such 
comparisons  is  quite  inadequate.    Progress  is  being  made  to 
allow  state-by-state  comparisons  for  National  Assessment  of 
Educational  Progress  (NAEP)  results.    This  is  very  much  to  be 
encouraged  as  is  argued  further  below. 

Another  issue  is  whether  current  tests  are  measuring  the 
higher-order  skills  that  are  needed  to  function  in  a  modern, 
technological  society.    There  are  also  concerns  that  school 
curricula  have  narrowed  to  fit  the  narrow  focus  of  tests  on 
mastery  of  elementary- level  basics  even  in  the  higher  grades. 
Thus,  therr  is  a  challenge  to  improve  the  adequacy  of  outcome 
measures  and  to  do  so  in  a  manner  that  does  not  improperly 
distort  the  purposes  of  education. 

With  respect  to  participation,  the  amount  of  schooling 
people  receive  and  drop-out  rates  are  important  items  of 
information.    But  in  my  experience,  the  most  sought  after 
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indicator  has  been  course  enrollment  data.    Three  excellent 
surveys  of  course  enrollments  were  carried  out  by  NCES  in  19^8 r 
1960,  and  1972  but  none  since  then.    Some  information  on  course 
eurollment  behavior  is  part  of  High  School  and  Beyond r  but  it 
is  not  comparable  to  the  aforementioned  survey  data  and  is  not 
reliable  insofar  as  it  is  self -reported,    A  regular  program 
(say,  every  five  years)  for  collecting  course  enrollment  data 
is  urgently  needed,      NCES  might  consider  doing  so  in  a  less 
-exhaustive  manner  than  was  the  case  for  the  1948 ,  1960,  and  • 
1972  surveys  in  order  to  control  costs  and  reduce  respondent 
burden. 

With  respect  to  resources ,  I  have  already  observed  that 
information  portraying  educational  R&D  would  be  useful. 
Additionallyr :some  thought  should  be  given  to  the  question  of 

fuality  of  certain  resources r  especially  teachers.    I  note  with 
nterest  that  the  preprint  of  Indicators  of  Educational  Status 
and  Trends  (1985)  attempts  to  do  this. ^  Additionally,  the 
importance  of  information  regarding  the  quality  of  the  teaching 
force  is  emphasized  by  the  National  Research  Council  report 
(1985). 

A  matter  of  special  interest  is  the  flexibility  of  supply 
of  teachers.    While  there  are  many  reports  of  unfilled  teacher 
positions  especially  in  certain  fields  such  as  mathematics  and  ( 
science,  the  supply  of  degree  holders  in  mathematics  and 
science  in  jobs  other  than  teaching  is  high  (NSF,  1980).  A 
National  Education  Association  study  in  1983  also  noted  that  a 
large  number  of  persons  not  now  in  teaching  jobs  have  completed 
the  requirements  for  certification  as  ptiblic  school  teachers. 
Thus,  information  is  required  that  goes  beyond  the  numbers  of 
persons  in  teacher  preparation  programs  and  considers  the 
attractiveness  of  teaching  as  a  career  in  terms  of  salary  and 
working  conditions. 

•  Another  kind  of  information  that  might  be  sought  in  the 
resources  category  is  information  regarding  the  substantive 
content  of  programs  (NRC,  1985).    An  excellent  source  or 
surrogate  would  be  textbook  usage.    That  is,  information  about 
which  textbooks  are  widely  used  would  provide  information  about 
the  content  of  school  programs.    Publishors  accximulate  such 
information,  but  they  frequently  regard  it  as  proprietary. 

Impact  information  can  probably  be  developed  with  other 
agencies  of  government  (e.g.  Departments  of  Commerce  and  Labor) 
that  ad'^ress  issues  of  economic  vitality  and  personnel  needs. 
Inclusion  of  information  in  this  category  is  especially 
important  now  and  for  the  foreseeable  future  because  of 
fundamental  changes  obviously  taking  place  in  labor  markets. 
The  decline  of  traditional  manufacturing  jobs  and  the  rise  of 
the  information  society  create  a  situation  where  the  kinds  of 
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academic  abilities  schools  are  best  at  developing  appears  to  be 
increasingly  In  demand  (Resnick  and  Resnick,  1985).  Moreover, 
this  category  clearly  expands  the  notion  of  what  information  is 
relevant  to  monitoring  elementary  and  secondary  education  in 
light  of  a  sensitive  understanding^  of  the  mission  of  the 
education  system.  .  . 

With  respect  to  purposes  education  Is  expected  to  address, 
I  have  referred  to  the  National  Commission  on  Excellence  and 
the  National  Science  Board  Commission  as  sources.  *  High  school 
graduation  requirements  would  be  another  Indicator  of  what 
people  expect  of  education.    Additionally,  expectations  of  the 
public  and  of  prospective  employers  might  be  surveyed  directly. 


In  summary,  NOES  Is  encouraged  to  emphasize  the  following 
data  sets: 

o       Outccme  information,'  especially  as  provided  by  the 

'  '      National  Assessment  of  Educational  Progress. 

o      * Participation  as  provided  by  course  enrollment  data* 

o  ^     Information  on  teachers  In  terms  of  guamtlty  and  quality. 

o       Information  on  currlcul\iro  content. 

Additional  Considerations  .  r\ r 

Some  considerations  In  addition  to  the  foregoing  on 
information  needed  to  address  Issues  of  monitoring  elementary 
and  secondary  education  are  presented.    The  additional 
considerations  are  five  In  number. r. 

International  Comparisons .    Current  concerns  about 
American  education  arise  substemtlally  from  the  belief  that 
U.S.  education  is  weakening,  but  other  nations  are  improving 
their  education.    IHhese  nations  Include  our  most  powerful 
econc^c  (Japan)  and  military  (U.S.S.R. )  competitors.  They 
have  made  strong  national  coranltments  to  and  have  displayed 
considerable  success  In  educating  large  proportions  of  their 
secondary  school  populations  to  higher  levels  of  skill  and 
understanding  than  Is  the  case  in  the  U.S.  (NSF,  1980).  This 
belief  Is  expressed  by  both  the  National  Commission  on 
Excellence  and  the  National  Science  Board  Commission. 

Nevertheless,  there  Is  some  controversy  about  the  belief 
as  stated  above.    For  example,  Americans  have  greater  access  to 
higher  education,  and  the  American  system  Is  much  more  flexible 
in  allowing  individuals  to  move  in  and  out  of  the  education 
system  over  their  entire  lives.    Thus,  international 
comparisons  between  elementary  and  secondary  education  systems 
and  practices  may  be  Inadequate.    One  must  look  at  life-long 
patterns  of  education  and  the  relation  of  education  to 
individual  and  societal  well-being.  In  any  case,  a  data  program 
designed  to  address  emerging  or  continuing  issues  should 
Include  consideration  of  the  International  scene  in  some 
realistic  way. 
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Informal ,  Out-of -School  Education.  Learning 
activities  in  schools  are  designed  to  be  structured  and 
intentional.    Yet,  there  is  increasing  recognition  that  much 
that  effects  the  quality  of  formal  education  occurs  outside  the 
classroom  and  beyond  the  control  of  the  school.    A  gieat  deal 
of  learning  takes  place  unintentionally  and  unconsciously 
through  casual  reading  and  other  experiences,  especially 
through  television  and  museums  (National  Science  Board 
Commission,  1983). 

Accordingly r  Information  regarding  education  in 
out -of -school  settings  should  be  studied.    We  have  already 
mentioned  television  and  museums  as  focal  points.  But 
libraries  and  community  groups  such  as  Boy  Scouts  and  Girl 
Scouts  should  also  be  taken  into  account. 

Technology.    Technology,  if  we  include  such  things  as 
books  and  chalkboards,  has  always  been  intrinsic  to  education. 
But  the  computer  and  other  complex  technologies  that  have 
recently  emerged  are  having  especially  significant  Impact  on 
both  the  content  and  delivery  of  education  (Buccino,  1985).  It 
is  desirable,  and  may  even  be  necessary,  to  identify  and 
collect  explicit  information  regarding  technology.    This  could 
include  information  on  misuse  or  ineffective  use  of  technology 
to  the  extent  that  these  occur. 

Data  Compatibility.    A  great  deal  of  data  is 
collected  at  the  state  level  and  by  other  institutions  and 
agencies.    Unfortiinately,  little  consideration  is  given  to 
compatibility  issues.    This  is  so  because  the  state-level  data 
collectors  have  little  guidance  and  are  not  in  a  good  position 
to  know  how  to  design  their  own  data  collection  for  such 
compatibility.    NCES  can  make  a  valuable  contribution  by 
developing  explicit  guidelines  for  state-level  data  collection 
that  provide  for  making  these  data  compatible  among  themselves 
and  with  the  national  data  sets.    Of  course,  following  the 
guidelines  would  be  voluntary. 

Interpretation.    Data  cry  for  interpretation.  When 
educational  data  are  published  in  the  press  or  reported  on 
television,  we  are  deluged  with  requests  from  the  public  to 
explain  what  they  mean.    Moreover,  the  publication  of  data,  as 
such,  can  even  be  misleading  in  the  absence  of  appropriate 
interpretation.    Accordingly,  I  strongly  urge  that  NCES  engage 
other  programs  in  the  Department  of  Education  and  other  federal 
agencies  to  encourage  and  support  interpretations  of  data  from 
NCES  and  other  sources. 

.1  interesting  example  regarding  the  need  for  careful 
intei^  etation  concerns  the  impact  of  high  technology  on  the 
knowledge  and  skill  levels  needed  by  workers.    Some  argue  that 
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as  technological  complexity  of  the  U.S,  economy  increases r  jobs 
at  all  levels  increasingly  require  higher  levels  of  knowledge 
and  skill.    But  Levin  and  Romberger  (1983)  argue  that 
proliferation  of  high  technology  industries  and  their  products 
is  far  more  likely  to  reduce  the  skill  requireirients  of  jobs  in 
the  U.S.  than  upgrade  them*      While  questioning  the  impact  of 
technology  on  the  knowledge  and  skills  needed  for  the  economy, 
Levin  and  Romberger  do  argue  for  higher  levels  of  education  on 
the  basis  of  the  ideal  of  informed  citizens  and  personal 
well-being. 

To  a  certain  extent ,  the  Condition  of  Education  and  other 
HCES  data  publications  have  tried  to  do  this.    What  I  suggest 
here  is  something  like  a  series  of  about  five  substantial 
interpretive  papers  annually  to  be  published  along  with  data 
sets.    Such  papers  might  well  focus  on  emerging  issues  with  a 
separate  discourse  for  tracking  continuing  issues.    The  image 
here  is  a  modified  Condition  of  Education.    It  would  have  two 
parts.    One  part  would  present  data  in  graph  and  table  form 
organized  in  accord  with  the  framework  and  categories  suggested 
earlier.    The  other  part  would  comprise  a  collection  of  about 
five  substantial  analytic  and  interpretive  papers  focusing  on 
emerging  issues  and  a  review  of  status  regarding  continuing 
issues. 

The  Problem  of  Standards  and  the  Importance  of  Comparisons 

The  paper  is  closed  with  a  discussion  of  why  data 
comparison  is  especially  important.    While  it  is  relatively 
easy  to  develop  criteria  to  monitor  the  adequacy  or  performance 
of  the  education  system,  it  is  much  more  difficult  to  develop 
standards  ~  which  determine  the  degree  to  which  criteria  are 
met.    A  criterion  is  a  characterizing  mark  or  quality.    In  this 
context  criteria  might  well  be  the  categories  forming  a 
framework  for  assessing  the  condition  and  progress  of  the 
American  education  system  that  were  discussed  earlier.  These 
are:  outcomes ,  participation,  resources,  impact,  and  purposes. 

A  standard  is  an  exemplar  of  a  criterion,  a  definite  level 
or  degree  of  the  quality,  defined  by  the  criterion,  that  is 
adequate  for  a  specific  purpose.    For  example,  large  may  be  a 
criterion,  while  for  different  purposes  the  Empire  State 
Building,  or  a  whale,  or  a  meter  may  constitute  the  definite 
level  or  degree  of  largeness  that  is  adequate. 

Given  a  criterion,  there  are  two  essential  methods  for 
establishing  a  standard.  One  is  to  identify  an  objective 
exemplar.  We  do  this,  for  example  in  the  case  of  length,  when 
we  select  a  certain  specific  platinum-iridium  bar  to  represent 
the  length  of  one  meter  and  p^'ace  it  in  the  Standards  vault  in 
Paris.  Thereafter,  an  object  is  said  to  have  length  one  meter 
if  it  is  equal  in  length  to  the  exemplar,  the  platinum-iridium 
bar  in  the  vault. 
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But  we  do  not  always  have  an  objective  exemplar  identified 
in  this  way  to  place  in  a  vault.    This  gives  rise  to  the  second 
method  for  establishing  a  standard.    This  is  the  method  of 
comparison.    It  is  not  always  easy,  for  example,  to  determine 
whether  a  given  object  is  large ,    However,  it  is  usually  quite 
easy  to  decide,  given  two  objects,  whether  one  is  larger  than 
the  other. 

Thus,  generally  speaking,  it  is  usually  quite  difficult  to 
determine  the  degree  to  which  a  given  object  possesses  a 
specific  quality.    On  the  other  hand,  given  two  or  more 
objects,  it  is  relatively  easy  to  compare  them  to  each  other 
with  respect  to  the  quality  in  question  and  assert  the  relative 
degree  of  the  quality  reflected  in  the  objects. 

This  illustrates  the  fundamental  problem  confronted  by 
NCES.    Given  such  criteria  as  we  have  discussed,  there  are  very 
few  objective  exemplars  for  measuring  the  degree  to  which  a 
school  system  possesses  these  qualities.    The  only  recourse  is 
comparison,  and  comparison  is  controversial  from  a  political 
point  of  view.    If  the  condition  of  one  school  system  is 
"better"  than  another,  then  ~  logically  —  the  other's 
condition  has  to  be  "worse"  than  that  of  the  first.    It  may  be 
all  right  to  be  better,  but  it  is  usually  unacceptable  to  be 
worse. 

In  this  paper,  we  set  forth  a  sat  of  criteria  (qualities) 
that  NCES  should  use  in  monitoring  the  U.S.  education  system. 
Typically,  exemplars  for  these  criteria  are  not  available. 
Accordingly,  NCES  must  consciously  develop  a  comparative 
approach  in  order  to  set  forth  standards  to  accompany  the 
criteria.    As  we  have  suggested,  the  comparisons  may  be  among 
states.    They  may  also  be  among  nations  and  within  states. 
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DATA  NEEDS  FOR  SCHOOL  POLICY  IN  THE  NEXT  DECADE 


James  S.  Coleman 
The  University  of  Chicago 


Prologue 

Because  there  will  likely  be  extensive  redundancy  in  the 
recommendations  made  to  NCES  by  various  educational  researchers, 
policy  makers  and  interested  parties,  and  because  much  of  what  I 
would  write  were  I  to  be  comprehensive  would  merely  increase  the 
redundancy,  I  have  chosen. not  to  be  comprehensive.  Instead,  in 
Part  I  of  the  paper,  -  I  have  focussed  on  a  single  kind  of 
problem,  one  for  which  I  believe  there  will  be  little  redundancy 
with  other  recommendations.  I  do  so  not  primarily  to  increase 
the  distinct  information  my  paper  will  transmit,  but  primarily 
to  focus  the  attention  of  NCES  on  a  very  important  set  of 
prospective  problems  in  education,  and  on  the  importance  of  a 
body  of  data  relevant  to  those  problems.  Because  of  the 
importance  of  the  problem  to  be  discussed  in  this  paper,  I 
believe  these  measures  will  show  ;  strong  effects  on  school 
outcomes.  In  addition,  the  measures  focus  on  matters  which  are 
directly  subject  to  policy  intervention. 

After  Part  I,     which  addresses     this  single  problem,  I  will 

address     in     a    Part  II  some    additional  points,     only  loosely 

related     to  the  first  and  to  one  another,  concerning  NCES  data 

collection    activities.        Because    these  points    are  somewhat 

disparate,  I  have  separated  them  off  into  a  Part  II. 


Part  I:  The  School,  The  Family,  and  the  Community 

Part  I  of  this  paper  is  based  on  a  single  premise:  that  in 
the  decades  to  come,  elementary  and  secondary  schools  (and  pre- 
elementary  schools  as  well)  will  be  unable  to  function 
successfully  unless  they  regard  their  task  as  something  beyond 
that  of  educating  the  individual  student.  More  specifically, 
the  premise  is  that  unless  the  school  comes  to  provide  certain 
functions  that  have  been  traditionally  regarded  as  provided  by 
the  home  and  the  community,  it  will  be  increasingly  unsuccessful 
in  its  task.  This  premise  is  not  based  on  a  notion  that  schools 
should  take  -on  additional  tasks  such  as  "the  teaching  of 
values",  or  other  tasks,  but  rather  that  in  order  for  schools  to 
succeed  at  their  central  task  of  educating  children,  they  must 
approach  this  task  quite  differently  than  they  have  in  the  past. 

The  form  this  part  of  the  paper  will  take  is  to  first 
provide  justification  of  this  premise,  second,  to  discuss  some 
of  its  implications  for  the  functioning  of  the  school,  and 
finally     to  indicate  implications  for  the  kind  of  data  that  will 
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oe  necessary  to  account  for  the  degree  of  success  of  e  school  in 
its  task,  and  to  guide  school  policy. 

Changes  in^  society ,  and  how  they  affect  the  school '  s  task 

My  premise  is  that  the  success  of  schools  in  d v. cades  to 
come  will  depend  on  their  being  able  to  provide  functions  that 
have  traditionally  been  the  province  of  the  community  and  the 
home.  The     premise  Is  grounded  in  certain  large-scale  social 

changes  that  have  taken  place  and  are  continuing  to  take  place. 
It  is  these  social  changes  which  can  defeat  the  goals  of  the 
school  if  the  school  continues  to  address  these  goals  in  the  way 
schools  have  traditionally  done.  The  proposition  stated  in  its 
most  general  form  is  that  in  the  presence  of  a  changed  social 
structure  outside  the  school  walls*  the  school  itself  must 
change  if  it  is  to  accomplish  the  same  goals  it  has  pursued 
prior  to  the  societal  change.  Stated  in  this  way,  the 
proposition  is  almost  trivially  true.  It  is  the  specifics  which 
give  informational  content,  and  it  is  to  those  that  I  now  turn. 

I  begin  with  the  observation  that  schools  have  always  been 
most  successful  with  children  from  strong  families.  That  has 
generally  meant  families  from  !iignt:i  soc  i-econcmic  status, 
families  with  a  stronger  educational  background,  and  £3milies 
which  the  parents  themselves  provide  a  verbally  rich 
environment.  Consistent  with  this  is  the  fact  that  younger 
children  in  a  family  achieve  slightly  less  highly  than  does  the 
oldest  sibling,  for  it  is  the  oldest  sibling  whose  verbal 
environment  as  a  young  child  has  had  the  highest  fraction  of 
adults  in  its  composition. 

Schools  have,  however,  not  always  been  successful  with 
children  from  well-educated  and  high  socio-economic  status 
families.  Children  from  families  disrupted  by  divorce  do  not  do 
as  well  in  school  as  children  from  intact  families,  and  children 
from  high  socio-economic  families  in  which  the  parents  are 
inattentive  or  disorganized  have  traditionally  been  the  "problem 
children"  of  elite  boarding  schools.  At  the  other  extreme, 
schools  have  often  been  successful  with  children  from  strong 
families  in  which  the  parents'  education  is  limited.  Schools 
were  successful  with  many  children  of  earlier  generations  from 
rural  or  immigrant  backgrounds  in  which  there  was  little 
education,  but  a  high  degree  of  interest  in  the  children's 
education  and  a  high  degree  of  resolve  to  see  children  do  well 
in  school.  Schools  of  today  are  successful  for  many  children 
from  poor  families  with  limited  parental  education,  when  these 
families  are  strong  and  attentive  to  their  children's  success  in 
school • 

This  leads  to  the  second  observation,  that  schools  are  more 
successful  with  children  from  strong  communities  than  with 
children  from  disorganized  or  weak  communities.  The  prototype 
of    a     strong     community     is  the    rural     communities     of    a  few 


generations  past  and  some  ( though  not  all)  of  the  ^  ethnic 
immigrant  neighborhoods  of  a  few  generations  past •  In  those 
communities ,  the  social  norms  reinforcing  school  goals 
supplemented  the  family's  own  resources,  and  aided  the  success 
of  children  whose  families  might  otherwise  not  have  had 
sufficient  resources  to  insure  their  child's  success  in  school. 

The  prototype  of  the  disorganized  community  is  the  ghetto 
of  modern  central  cities*  in  which  illicit  and  illegal 
activities  distract  children  from  the  goals  of  the  school  as 
well  as  those  of  their  families*  In  such  communities «  the 
social  norms  conflict  with  school  goals,  run  counter  to  the 
family's  aims  an^'  undermine  the  success  of  the  children  whose 
families  might  'Otherwise  have  had  sufficient  resources  to  insure 
their  children's  success  in  school. 

But  it  is  not  only  ghetto  communities  which  can  undermine 
children's  success  in  school*  Any  community  with  a  high 
proportion  of  disorganized  families ,  or  with  parents  whose 
attention  is  so  fully  directed  to  their  own  problems  that  they 
give  little  time  to  their  children,  generates  norms  destructive 
to  children's  success  in  school*  A  recent  semi-autobiographical 
novel  of  a  20-year  old  young  man  who  grew  up  in  Beverly  Hills 
(title:  Less  than  Zero)  is*  instructive.  His  description  of  the 
youth  culture  in  that  community  of  high  inrome,  .high-status, 
well-educated  families  is  a  description  of  drugs,  sex,  violence, 
and  self -destructive  narcissism. 

A  third  observation  is  that  families  in  American  society 
are  becoming  less  strong  with  each  generation,  less  able  to 
provide  their  children  with  the  kind  of  resources  at  home  that 
their  parents  provided  for  them.  .Indicators  of  this  are  many: 
high  and  increasing  divorce  rates*  which  show  no  signs  of 
declining  to  earlier  levels,  the  replacement  of  family-wide 
leisure  activities  by  adult  social  activities,  "children's 
activities,"  and  youth  culture  activities  for  which  age-specific 
music  both  plays  an  important  part  and  indicates  the 
separateness.  The  increasing  fraction  of  mothers  of  pre-school 
children  in  the  labor  force  reduces  the  transmission  of  parental 
cognitive  resources  to  children.  A  general  shift  of  attention 
to  the  mass  media  of  entertainment  by  family  members  of  all  ages 
helps  undermine  family  values  and  attracts  attention  both  of 
parents  and  children  away  from  those  intra-f amily  ac tivities 
that  have  traditionally  aided  the  family  and  in  doing  so  aided 
the  school. 

Finally,  a  fourth  observation  is  that  some  of  these  same 
social  changes,  together  with  others,  have  greatly  weakened  the 
local  adul t  community  served  by  a  school ,  and  have  largely 
destroyed  those  norms ,  and  the  sanctions  accompanying  them ,  upon 
which  families  and  schools  have  in  the  past  depended.  In 
addition  to  the  social  changes  described  above  that  lead  to 
family  disorganization  and  parental  inability  to  reinforce  the 
school's     goals,     there     is     the  major  social    change    in  which 
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fathers,  and  increasingly  mothers^  work  outside  the  local 
community  where  their  child  attends  school.  This  change,  which 
takes  parents  out  of  the  local  community,  removes  the 
possibility  of  a  strong  set  of  community  norms  which  can 
reinforce  the  school's  goals.  A  complementary  change  has  added 
to  this  effect,  for  in  many  places  the  schools  too  have  moved 
out  of  the  community.  This  has  occurred  in  some  places  through 
school  consolidation,  in  some  places  through  school 
desegregation,  and  in  some  places  through  staff 
prof essionalization ,  which  has  moved  teachers  away  from  personal 
involvement  in  the  community  where  they  teach. 

These  four  observations  taken  together  point  to  the  new 
challenges  that  have  come  to  confront  elementary  and  secondary 
schools,  and  will  increasingly  confront  them  in  the  future. 
Together,  the  first  and  third  observations  imply  that  schools 
will  increasingly  be  populated  by  children  from  homes  in  which 
the  resources  that  schools  have  depended  on  will  be  absent  or 
not  used  in  the  service  of  school  goals,  and  that  schools 
pursuing  their  task  as  they  have  in  the  past  will  be  less  and 
less  successful.  Together,  the  second  and  fourth  observations 
imply  that  the  community  surrounding  a  school  will  be 
decreasingly  a  support  to  the  school's  goals,  increasingly  an 
impediment,  and  that  schools  failing  to  modify  their  activities 
will  find  themselves  with  an  increasingly  unmanageable  student 
population* 


Implications  for  the  successful  functioning  of  a^  school 

The  changes  I  have  described  above  leave  children  with  less 
adult  attention,  less  adult  interest,  and  less  adult  control 
than  has  been  true  in  the  past.  Schools  which  do  nothing  new 
will  find  themselves  with  children  more  psychologically  isolated 
as  well  as  with  children  more  controlled  by  peers,  commercial 
entertainment,  and  exploitative  adults  than  in  the  past.  To 
prevent  this,  I  see  two  possible  avenues  for  schools  to  pursue. 
One  is  to  help  strengthen  and  rebuild  the  social  structures  in 
home  and  community  which  have  in  part  abandoned  children  to  the 
school  and  to  peers,  and  the  other  is- to  build  compensating 
social  structures  as  part  of  school  activities.  . 

The  first  of  these  strategies  implies  two  tasks,  one 
focussing  on  the  home  and  thr  second  focussing  on  the  community. 
Stated  quite  generally,  the  first  task  is  to  involve  parents  in 
their  children's  education,  a  task  which  will  result  in  greater 
expenditure  of  parental  resources  (such  as  attention  and 
interest)  on  the  child  and  the  child 's  education  than  would 
otherwise  be  true.  To  carry  out  this  task  requires  a  shift  in  a 
direction  opposite  to  that  which  schools  and  teachers  have  taken 
in  recent  years.  It  requires  encouraging  parents  to  become 
involved  in  the  school,  even  at  the  cost  of  having  to  take 
parents'  interest  and  demands  into  account.  It  requires 
removing     the     shield  that  many  teachers  and  many     schools  have 


ERLC 


used  to  keep  out  parental  interference. 


The  matter  may  be  put  in  terms  of  two  diagrams,  which,  at 
the  risk  of  oversimplifying  can  serve  as  a  useful  mnemonic. 
Figure  lA  expresses  the  current  form  of  relation  between  home, 
child  and  school  in  m'^st  communities,  with  the  child  as  the  only 
linkf  while  Fipure  IB  expresses  the  form  of  relation  that  is 
necessary  if  the  school  is  to  successfully  involve  parents  in 
their  children  *  s  education  a ad  strengthen  the  home  *s  capability 
of  reinforcing  school  goals. 


teacher 


Figure  lA:  School-Home  Separation        Figure  16:  School-Home  Closure 

Figure  .lA  is  meant  to  denote  a  school-home  relation  which 
is  entirely  mediated  by  the  child:  The  child  has  a  relationship 
with  parent  within  the  context  of  the  home,  and  with  teachers 
within  the  context  of  the  schooli  but  these  relations  are 
separate  and  distinct.  There  is  no  linkage  between  school  and 
home  other  than  the  child. 

Figure  IB  represents  a  situation  I  will  describe  as 
"school-home  closure."  It  is  meant  to  denote  a  school-home 
relation  which  is  mediated  not  only  by  the  child,  but  by  either 
or  both  of  two  others:  by  the  teacher ,  moving  from  the  school 
irto  the  home  context,  through  home  visits;  and  by  the  parent, 
moving  from  the  home  into  the  school  context.  For  some  parents 
who  can  or  will  spare  little  time  for  their  children's 
schoolings  this  may  mean  only  school  visits  or  participation  in 
school  events .  For  others ,  it  can  mean  involvement  through 
volunteer  services  at  the  school. 

Whatever  the  form  of  school-home  closure,  for  the  school  of 
the  future  which  pursues  this  strategy  of  strengthening  the  home 
environment,  any  of  these  activities  should  be  accompanied  by 
pedagogical  activities  from  the  school  to  the  parent: 
Recognizing  that  many  parents  are  cut  off  from  those  kinship  and 
neighbor  "resources  v;hich  can  transmit  information  about  the 
kinds  of  rules,  practices,  and  facilities  in  the  home  that  will 
help  the  child  be  successful  in  school ,  the  school  itself  takes 
on  the  task  of  transmitting  this  information  and  encouraging  the 
parent  to  use  it . 

The  second  task  for  a  school  which  chooses  the  strategy  of 
strengthening     and  rebuilding  the  home  and  community  structures 
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is  a  task  which  focusses  on  community  structure.  The  aim  in 
strengthening  the  community  structure  is  to  facilitate  the 
creation  of  a  set  of  norms  and  accompanying  sanctioning 
mechanisms  in  the  community  that  wi.ll  reward  those  activities  of 
children  and  youth  which  are  in  the  direction  of  goals  of 
schools  (and  parents),  and  negatively  sanction  those  activities 
of  children  and  youth  which  go  against  goals  of  schools.  This 
is  an  orientation  that  was  more  prevalent  in  communities  when 
the  school-and-neighborhood  more  often  constituted  a  functional 
community  than  is  true  today.  In  the  fractionated  communities 
that  are  found  in  much  of  America  today,  the  absence  of  school 
involvement  with  the  community  is  merely  one  indicator  of  the 
general  decline  of  the  community.  This  is  nol  to  say,  of 
course,  that  a  "community  school"  orientation  is  not  to  be  found 
in  some  American  schools,  for  of  course  it  is.  The  present 
point  is  that  this  orientation  c£n  ^e  especially  important  in 
strengthening  those  communities  that  are  unable  to  reinforce 
school  goals. 

At  the  risk  of  oversimplifying,  the  kind  of  community 
structure  which  is  able  to  develop  norms  and  apply  sanctions 
reinforcing  schools'  and  parents'  goals  for  chjldren,  a  contrast 
may  be  made  between  community  structures  with  what  I  will  call 
"intergenerational  closure"  and  those  without  such  closure.* 
Structures  that  exhibit  this  closure  can  be  described  as  those 
in  which  friends  and  associates  of  a  child's  parents  are  also 
parents  of  the  child's  friends  and  associates.  As  in  the  case 
of  school<-home  closure,  intergenerational  closure  may  be  shown 
by  comparing  two  diagrams.  In  the  diagrams,  the  vertical  lines 
represent  parent«-child  links  across  generations,  while  the 
horizontal  lines  represent  friendship  and  associational  links 
within  generation. 
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Figure  2A: 
Intergenerational  Separation 


Figure  2B: 
Intergenerational  Closure 


♦In     "Schools    and  the  Communities  they  Serve"     (Phi  Delta 
Kappan ,  April  1985),   I  examine  this  contrast  in  greater  detail. 
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Figure  lA  characterizes  a  social  structure  in  which  there  is 
separation  between  the  community  of  children,  focussed  around 
the  school,  and  the  networks  of  relations  in  which  parents  find 
their  friends  and  associates.  In  con-muni  ties  where  most 
families  have  both  parents  working  outside  the  community,  and 
others  are  single-parent  faiLilies,  many  of  the  friendship  and 
association  relations  will  go  outside  the  local  community,  and 
the  social  structure  will  approximate  Figure  lA, 

Figure  IB  characterizes  a  .social  structure  in  which 
networks  of  relations  which  connect  adults  are  largely 
coterminous  with  the  community  of  children  in  the  school •  The 
intergenerat ional  closure  that  results  makes  possible  a  flow  of 
information  among  parents  about  children,  and  about  school*  This 
flow  of  information,  in  turn,  facilitates  the  growth  of  norms 
and  the  application  of  sanctions  by  the  community,  both  posit1.ve 
and  negative,  whiph  shape  children's  behavior.  Parents  will 
discuss  what  is  acceptable  behavior  and  what  is  not,  parents  and 
children  will  be  congratulated  for  achievements  of  the  child, 
and  parents  are  not  afraid  to  sanction  the  behavior  of  children 
who  are  not  their  own. 

If  a  school  chooses  the  strategy  of  strengthening  ai:id 
rebuilding  the  social  structure  of  the  community  in  a  way  that 
reinforces  school  goals,  it  will  do  so  through  attempting  ':o 
create  structures  like  Figure  IB,  where  the  structure  is 
currently  like  Figure  lA.  In  short,  it  must  create  and 
strengthen  relations  among  parents  of  children  in  the  school  if 
those  relations  are  to  sustain  norms  that  strengthen  ':he 
school's  goals.  There  are  a  variety  of  ways  this  can  occur. 
The  most  obvious  are  parent's  associations  and  PTAs, 
organizations  which  many  schools  do  little  to  foster  except 
where  they  arise  naturally  (which  is  principally  in  communities 
with  structures  like  Figure  IB,  where  they  are  least  needod). 
In  private  schools  and  public  schools  which  are  attended  by 
choice,  parents  are  sometimes  required  to  commit  themselves  to 
so»Tie  school  event  or  activity  which  involves  working  with  o?:her 
pars^nts .  In  various  schools,  there,  are  parent-sponsored 
activities  such  as  auctions  and  bake  sales.  In  addition, 
however,  ad  hoc  parent's  groups  are  sometimes  formed  at  a  time 
of  crisis  around  some  problem  area,  such  as  drug  or  alcohol 
abuse . 

A  3ecbnd  strategy  for  schools  confronted  with  weak  or 
disorganized  families,  or  with  weak  or  disorganized  communities, 
or  with  both,  is  to  build  a  compensating  social  structure 
through  and  around  school  activities  themselves.  This  strategy 
can  be  found  most  fully  pursued  in  boarding  schools ,  many  of 
whose  children  are  present  precisely  because  of  family 
disorganization  or  parental  desire  to  be  freed  from  daily 
attention  to  children 's  schooling.  The  social  order  established 
in  these  boarding  schools  may  range  from  the  hierarchial  form  of 
an  Eton  to  the  communitarian  and  egalitarian  form  of  a 
Summerhill  or  an  Ecole  d'Humanite.     But  whatever  the  form,  it  is 
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a  social  order,  with  norms,  demands,  and  sanctions  which 
surround  its  members,  and  which  a  school  with  a  mimimum  of 
sociological  skill  can  shape.  It  is  not  a  child-destructive 
social  disorganization  that  exists  in  the  larger  society  in  the 
absence  of  strong  families  and  strong  communities. 

Absent  a  boarding-school  setting,  schools  beyond  the  lower 
elementary  level  may  —  and  many  do  —  attempt  to  capture  the 
interest  and  involvement  of  children  and  youth  through  extra- 
curricular activities  of  various  kinds.  Many  students  whose 
unexceptional  academic  potential  and  lack  of  parental  attention 
provides  little  incentive  for  intense  involvement-  in  school 
nevertheless  do  come  to  be  intensively  involved  through  some 
form  of  extra-curricular  activity.  In  the  presence  of  weakening 
community  and  family  organization,  some  new  pattern  of  extra- 
curricular activity  may  evolve  in  schools  to  bring  a  broader 
range  of  activities  and  interests,  for  a  larger  fraction  of 
students,  under  the  umbrella  of  school  supervision. 

In  this  section,  I  have  described  the  implications  for 
school  functioning  of  the  changing  structure  of  the  family  and 
community  for  school  functioning.  In  the  next  section,  I  will 
indicate  some  implications  for  data  collection  activities  of 
NCES. 


Implxcation  for  NCES  data  collection  activities 

The  scenarios  described  above  have  various  kinds  of 
implications  for  NCES  data  collection  activities.  First  are 
implications  for  new  measurements  that  assess  the  kinds  of 
social  structural  setting  —  the  kinds  of  family  organization, 
the  kinds  of  community  organization,  and  the  link  between  school 
and  home  and  between  school  and  comiuanity*  Second  are 
implications  for  measurement  of  school  practices  that  act  either 
to  strengthen  or  to  substitute  for  weakened  home  and  community 
organization.  Third  are  implications  for  ways  in  which  NCES 
data  activities  themselves  might  augment  parental  resources, 
strengthening  their  capacity  to  aid  their  children's  education. 


MeasurinR  the  social  structure  and  its  relation  to  school ;  If 
the  overall  premise  of  this  paper  is  true,  data-gathering 
activities  designed  to  provide  information  for  school  policy 
(like,  for  example,  NCESs  High  School  and  Beyond)  should  obtain 
data  that  measures  family  characteristics,  the  school's  relation 
to  the  family,  community  organization,  and  the  school's  relation 
to  the  community.  Reasonably  good  measures  of  the  first  of 
these  (which  show  strong  relations  to  student  performance) 
already  are  used  in  some  NCES  data<*collection  (e.g.,  High  School 
and  Beyond);  it  is  the  othe  three  that  are  largely  missing. 

The    kind     of    ilata     necessary  can    best     be    described  by 
reference  to  Figures  1  and  2,  for  what  is  needed  are  measures  of 
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the  relations  that  differentiate  Figure  IB  from  lA,  and  2B  from 
2A«  None  of  these  are  characteristically  measured  in  NCES  data- 
collection,  though  in  High  School  and  Beyond,  there  *is  one 
measure  that  can  aid  in  distinguishing  IB  from  lA,  both  at  the 
individual  student  level  and  at  the  school  level.  This  measure, 
obtained  only  incidentally  and  so  far  not  used  in  analysis  of 
HS&B  data,  is  a  question  in  the  teacher  ccciment  checklist  asking 
for  each  student  in  the  sample  (after  a  question  as  to  whether 
the  teacher  knows  that  student)  whether  the  teacher  knows  the 
parent*  This  allows  measurement  of  the  degree  to  which  there  is 
some  form  of  school-home  closure,  though  it  does  not  allow 
distinguishing  whether  the  closure  occurs  through  the  teacher  in 
the  home  context  or  through  the  parent  in  the  school  context 
(see  Figure  IB). 

Additional  measures  which  would  obtain  information  directly 
relevant  to  school-home  closure  and  intergenerational  closure 
have  been  absent  from  NCES  data-collection,  though  they  could 
easily  be  included  in  instruments  of  the  sort  already  used* 
Information  on  both  types  of  closure  could  be  obtained  in 
student  questionnaires  of  the  sort  use'^  in  HS&B  and  the  National 
Longitudinal  Longitudinal  Survey  of  1972  High  School  Seniors. 
When  there  are  in  addition  parents'  questionnaires  or  interviews 
(as  in  a  subsample  in  HS&B),  then  even  more  direct  and  reliable 
measures  relevant  to  the  structures  shown  in  Figure  1  and  2  can 
be  obtained.  (It  is  surprising,  in  fact,  that  in  the  HS&B 
parents'  questionnaire,  neither  information  on  the  parent's 
involvement  with  the  school  nor  information  on  the  parent's 
involvement  with  parents  of  other  children  in  the  school  were 
obtained.) 

I  will  not  go  into  the  particularities  of  just  what  kinds 
of  instruments  and  items  may  be  most  useful  for  obtaining  the 
relevant  data,  for  that  is  relatively  straightforward.  The 
essential  point  is  che  recognition  of  what  kinds  of  data  are  at 
issue  here,  and  the  potential  importance  of  such  data  for 
assessing  the  functioning  of  schools  in  the  coming  decades. 


Measuring  school  policies  and  practices  relevant  to  social 
structure  t  In  the  earlier  section  on  implications  for  the 
successful  functioning  of  a  school,  I  have  indicated  some  of  the 
kinds  of  school  policies  and  practices  that  schools  have 
initiated,  and  others  that  can  be  initiated,  to  alleviate  the 
harmful  Impact  of  changes  in  social  structure.  This  is  only  a 
beginning.  Exploratory  ethnographic  studies  and  pilot  studies 
can  be  initiated  to  discover  the  full  panoply  of  such  policies 
and  practices  that  exist  in  American  schools.  Once  such 
information  is  at  hand,  it  can  provide  the  basis  for  Instruments 
or  items  that  can  measure  the  extent  of  these  policies  and 
practices.  What  is  essential  now  is,  as  in  the  measurements 
described  in  the  previous  section,  that  the  kind  of  data  under 
discussion  is  clear,  and  that  the  potential  importance  of  such 
data     for     explaining     the  differential  success     of     schools  is 
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Use  of  NCES  data  activities  to  augment  parental  resources;  In 
both  the  preceding  sections,  measurements  were  described  which 
would  have  analytical  value  for  rolicy-relevant  research  on 
school  functioning*  But  there  is  another  kind  of  value  that 
NCES  activities  can  have  for  the  problems  I  have  described* 
This  is  the  encouragement  and  facilitation  of  parental  and 
community  use  of  information  about  student  performance  and 
school  functioning. 

Schools  and  school  systems  have  been  quite  variable  in  both 
willingness  to  provide  parents  and  the  community  they  serve  with 
data  about  student  and  school  functioning ,  and  their  ability  to 
provide  such  data.  It  was  only  through  pressure  from  newspaper 
reporters  that  big-city  school  systems  began  to  make  public 
standardized  achievement  data  at  the  school  level*  It  was  only 
Federal  freedom-of -information  legislation  that  gave  parents 
rights  to  access  to  school  records  on  their  own  children,  and 
many  schools  discourage  the  use  of  these  rights  by  parents •  Yet 
this  kind  of  discouragement  is,  if  thfj  premise  on  which  this 
paper  is  based  is  correct,'  increasingly  inimical  to  the 
successful  functioning  of  the  school*  Parental  resources,  and 
interest  in  using  these  resources  to  benefit  their  child's 
education,  can  be  amplified  by  free  and  easy  access  to 
information  both  about  their  children's  progress  and  about  the 
school's  functioning*  Community  organization  is  more  likely  to 
be  applied  toward  the  improvement  of  education  if  facts  which 
many  school  systems  attempt  to  keep  hidden  (such  as  frequencies 
of  various  forms  of  violence,  delinquency,  and  crime  in  the 
school,  or  the  frequency  of  cutting  classes  or  teachers'  absence 
rates)  were  made  public*  An  important  role  of  NCES  is  to  act, 
in  effect,  as  a  representative  of  the  consumers  of  education 
with  respect  to  information  relevant  to  their  interest*  (In  the 
past,  NCES  data  services  have  been  more  use  to  education 
producers  than  consumers  * )  Some  specific  steps  which  can  be  of 
aid  in  this  task  are: 

1*  Publication  of  a  booklet  Informing  parents  of  their 
information  rights  vis  a  vis  their  children 's  schools ,  public 
and  private,  and  giving  information  about  how  to  interpret  the 
usual  items  of  information  in  school  records.  Such  a  booklet 
should  indicate  also  information  about  school  functioning  that 
schools  are  required  by  state  law  to  keep,  or  would  normally 
keep  as  part  of  school  management.^  with  an  indication  of  what 
kinds  of  information  would,  if  parent  groups  can  induce  schools 
to  make  it  public,  be  most  valuable  as  indicators  of  school 
functioning  (e*g* ,  monthly  teacher  and  student  absence  rates, 
yearly  standardized  achievement  gains ,  dropout  and  transfer 
rates  at  each  grade  level) * 

2*  Publication  of  material  disseminated  to  school  systems 
giving  specifications  for  an  appropriate  system  of  provision  of 


consumer  information,  so  that  school  districts  that  -are  so 
inclined  will  have  a  standard  to  turn  to.  Such  a  system  can  be 
designed  to  make  use  both  of  information  required  b v  the  state 
department  of  education  and  of  NAEP  or  NAEP-like  information. 

3.  .Design  of  a  system  of  consumer  information  to  accompany 
newly-introduced  plans  of  school  choice  that  states  or  school 
districts  elect  to  introduce,  either  within  the  public  school 
system  or  including  non-public  schools  as  well. 

These  are  specific  examples  of  the  type  of  information 
services  that  NCES  can  provide  and  can  stimulate  which  will  have 
a  direct  effect  in  strengthening ,  not  the  family  structure  or 
community  structure,  but  the  ability  of  families  and  communities 
to  support  and  aid  their  children's  education.  Schools  have 
erroneously  equated  their  comfortable  insulation  from  parental 
and  community  pressures,  and  from  the  exercise  of  parental 
choice,  with  benefits  to  students.  The  educational 
establishment,  NCES  included,  has  done  little  to  counter  that 
self-serving  action.  But  as  the  principal  Federal  information 
agency  on  education  matters,  NCES  has  both  a  responsibility  and 
an  opportunity  to  swerve  and  protect  the  interests  of  consumers 
of  educational  services.  This  is  the  spirit  of  the  large  state- 
by-state  comparison  chart  of  educational  inputs  and  outputs 
which  NCES  has  just  published;  That  spirit  should  be  present  in 
a  much  broader  set  of  services,  such  as  those  described  above, 
which  can  stimulate,  encourage,  and  generate  pressure  for  the 
opening  up  of  information  about  school  functioning  to  parents 
and  community.  Such  services  were  less  important  when  schools 
were  closer  to  their  communities,  and  when. there  were  strong 
parental  communities  coterminous  with  communities  of  children 
and  youth.  But  they  are  important  now,  and  will  become 
increasingly  so  in  the  future. 
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Included  here  are  a  few  additional  points  about  NCES  data- 
collection  and  statistical  activities* 

!•  The  two  major  longitudinal  studies  of  high  school 
students,  the  National  Longitudinal  Study  of  High  School  Seniors 
of  19729  and  High  School  and  Beyond,  covering  high  school 
seniors  and  sophomores  in  1980,  have  proved  to  be 
extaordinarily  fruitful  longi tuidinal  data  bases  -  and  have 
shown  the  value  of  the  general  design  used  by  NCES  in  1972  and 
improved  in  1980*  To  continue  to  monitor  the  functioning  of 
American  high  schools  by  continuing  this  series  with  subsequent 
cohorts  is  very  important. 

In  addition,  the  experience  gained  from  NLS-72  and  HS&B, 
and  the  general  value  which  these  data  bases  have  shown,  should 
encourage  the  initiation  of  comparable  series  at  lower  grades  of 
school*  In  general,  it  appears  quite  useful  to  concentrate  NCES 
resources  on  obtaining  and  maintaining  longitudinal  data  bases 
on  comparable  cohorts  at  periodic  intervals,  as  in  the  case  of 
NLS-72  and  HS&B* 

2*  As  part  of  the  design  of  HS&B,  an  approach  called 
'^pluralistic  policy  research  design**  was  used  in  modification  of 
instrument  and  study  design*  (See  **Policy  Issues  and  Research 
Design, Report  to  NCES  October  1979,  by  James  Coleman,  Virginia 
Bartot,  Noah  Lewin-Epstein ,  and  Loraine  Olson*)  In  this  work, 
interested  parties  in  education,  most  nongovernmental,  and 
representing  as  wide  a  variety  of  interests  as  could  be 
identified  by  examining  testimony  before  legislative  commitless 
on  education  bills,  were  given  an  opportunity  for  input  to  be 
used  in  modifying  the  survey  design  and  instruments*  A  similar 
approach  has  been  discussed  by  Anthony  Bryk  under  the  rubric  of 
research  design  aided  by  stakeholder  inputs*  The  same  general 
orientation  is  evident  in  the  current  call  for  inputs  by  NCES, 
in  which  not  only  research  investigators  but  also  a  wide  range 
of  groups  with  interests  in  education  has  been  asked  for  input* 

It  would  be  wise  to  institutionalize  such  procedures  for 
all  research  engaged  in  by  NCES*  If  appropriately  incorporated 
into  research  design,  such  a  process  can  be  very  valuable,  for 
neither  research  investigators  nor  government  officials  are  in 
the  best  position  to  know  what  the  emerging  problems  in 
education  are*  Appropriately  institutionalized,  such  procedures 
become  an  important  part  of  democratic  processes  in  educational 
policy-making* 

3*  In  the  plans  for  HS&B,  it  was  proposed  to  NCES  by  the 
contractor  to  establish  an  on-line  HS&B  data  base,  to  make 
possible  direct  and  immediate  access  to  the  data  base*  The  data 
base    was     to  be  maintained  either  at  the    contractor's  central 
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computer  or  that  of  NCES,  and  accessed  via  the  educational 
computer  network,  EDJNET.  Such  an  arrangement  would  have  been 
especially  valuable  for  those  potential  users  whose  problems, 
resources,  and  time  were  too  small  to  justify  obtaining  public 
use  tapes  and  going  through  the  lengthy  process  of  getting  the 
data  up,  running,  and  able  to  deliver  output. 

NCES  did  not  accept  this  proposal  for  dissemination  and 
public  use  of  HS&B  data.  Yet  it  is  clear  tht  the  time  is  at 
hand  or  very  near  for  doing  something  like  this  with  at  least 
some  NCES  data  bases.  The  hardware,  software,  and 
communications  services  are  in  place,  so  that  the 
technologically  outmoded  means  of  disse'^inating  NCES  data 
(limited  to  printed  publication  or  mailing  of  public  use  data 
tapes)  can  be  augmented  by  electronic  access.  NCES  could  make 
its  data  exceedingly  more  useful,  both  for  research  purposes  and 
for  the  wide  range  of  other  purposes  that  education  information 
consumers  have,  by  putting  such  a  direct-access  system  in  place 
-  or  as  in  the  HSSB  proposal,  having  it  done  by  a  contractor  for 
one  of  its  more  widely-used  data  bases. 

As  promised  at  the  beginning  of  Part  II,  the  points 
contained  here  are  a  collection  of  disparate  points,  not 
connected,  though  I  regard  each  as  important  in  itself.  It  is, 
however.  Part  I  of  the  paper,  and  the  increasing  imoortance  of 
the  outside  social  structure  for  school  to  which  it  draws 
attention,  that  I  want  to  emphasize  most  strongly. 
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ISSUES  IN  NATIONAL  EDUCATIONAL  DATA  COLLECTION 


Joseph  M.  Cronin 


Introduction 

The  National  Center  for  Education  Statistics  plays  an  important  role  for  the  federal 
government  —  collecting  statistics  useful  for  local,  state  and  federal  decision- 
making about  education*  I  am  pleased  to  join  the  discussion  of  how  a  redesign  of 
NCES'  data  program  will  enhance  opportunities  to  collect  productive  information 
andy  further,  promote  innovative  strategies  for  distribution,  use  and  analysis.  As  my 
comments  will  illustrate,  I  support  a  simplified  sampling  system  of  educational 
attainment*  The  U*S*  needs  standard  definitions,  constant  vigilance  against 
redundancy  and  excessive  data  collection,  audits  and  verification  on  local  school 
data,  and  continued  attention  to  equity  results  as  well  as  excellence  and 
achievement* 

During  the  1960's,  I  was  one  of  several  Harvard  University  professors  of  educational 
administration  objecting  to  the  position  taken  by  the  American  Association  of 
School  Administrators  to  oppose  national  assessment  and  any  suggestion  of  testing 
or  federal  action  to  find  out  what  children  had  learned*  After  some  discussion, 
AASA  agreed  to  a  compromise  whereby  a  neutral  state-oriented  group,  the 
Education  Commission  of  the  States,  would  conduct  the  national  assessment  of 
educational  policy.  Neither  state  nor  local  school  districts  would  be  identified  in 
any  report* 

Less  than  twenty  years  later,  the  governors  and  legislatures  of  most  states  insist  Oti 
knowing  how  well  the  educational  system  is  performing  with  results  available  by 
school  district  and  often  by  school  building. 


ERIC 


113 


As  the  education  officer  in  one  Governor's  cabinet  and  the  chief  state  school  officer 
in  another  state,  I  grew  very  dissatisfied  with  existing  national  education  data  and 
data  collection  formats.  I  remain  very  critical  of  the  use  by  top  U.S.  official^  — 
including  the  President  and  Secretary  —  of  SAT  and  ACT  results  which  c?nnot  and 
should  not  be  used  to  evaluate  state  achievement  when  the  tests  were  intended  only 
to  predict  college  success  for  individuals.  The  SAT  scores  have  been  made  the  Dow 
Jones  indicator  of  educational  achievement.  This  is  the  wrong  scoreboard  and  in- 
appropriate information  to  use  to  compare  and  contrast  states. 

Fortunately,  the  Department  of  Education  has  begun  to  search  for  other  indicators- 
the  NAEP,  as  ^ell  as  longitudinal  studies  on  high  school  graduates,  and  other  state 
level  data.    This  is  a  positive  trend. 

The  Growing  Demand  for  Educational  Indicators 

For  the  last  twenty-five  years,  the  American  public  supported  increased  public 
expenditures  for  more  comprehensive  educational  and  health  services  —  especially 
for  those  who  lacked  access  to  quality  schools,  clinics  and  hospitals. 

Neither  educators  nor  medical  administrators,  however,  felt  obligated  to  compile  or 
release  to  the  public  any  systematic  data  about  the  accomplishments  and  failures 
of  their  institutions.  Now  the  public  wants  to  know,  employers  ne'^d  to  know,  and 
government  is  under  an  obligation  to  collect  and  present  these  data  in  under- 
standable and  responsible  formats. 

Recently,  the  U.S.  Department  of  Health  and  Human  Services  National  Health 
Council  voted  to  require  every  hospital  to  produce  a  profile  of  statistics  which 
would  be  available  to  Medicare  patients  and  the  general  public.  Among  the  more 
compelling  statistics  would  be  the  number  of  persons  who  die  each  year  in  each 
department  of  the  hospital  and  from  what  ailment.  Information  on  costs,  admissions 
practices,  length  of  stay,  quality  of  staff,  and  a  review  of  facilities  are  indeed  vital 
statistics  for  hospital  service  consumers.  Information  on  deaths  per  doctor  will  not 
be  available  due  in  part  to  very  strong  objections  from  the  American  Medical 
Association.  Taxpayers  and  people  seeking  medical  services  will  have  considerable 
information  due  to  this  "truth  in  healing"  policy  and  the  help  of  professional  review 
organizations  which  will  monitor  the  hospitals. 
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Concurrently,  an  industrial  location  advisory  service  called  FANTUS  regularly 
informs  companies  looking  for  a  new  facility  about  the  quality  of  state  and  local 
educational  systems.  An  employer  must  know  the  literacy  level  of  the  local 
workforce  from  which  new  workers  will  be  recruited.  Also,  employees  with  families 
transferred  to  the  new  site  want  to  know  the  answer  to  the  queries,  "How  good  are 
the  schools?"  and  "Where  are  the  best  schools?"  FANTUS  collects  and  summarizes 
all  the  available  data  on  school  size,  costs,  achievement,  and  other  potentially 
significant  indicators  of  quality,  including  the  numbers  of  graduates  going  to 
college. 

Thirty-six  states  have  required  local  schools  to  systematically  test  school  achieve- 
ment for  various  reasons  including  grade  to  grade  promotion  and  graduation  from 
high  school.  New  York  State  requires  a  series  of  tests  of  pupil  performance 
evaluations  well  in  advance  of  the  Regents  exams  for  college-bound  students. 

The  Limits  on  SAT/ ACT  Data 

The  President  of  the  United  States  and  NCES  ought  not  to  try  to  make  SAT  (or 
ACT)  scores  the  basis  for  state-by-state  comparisons  for  these  reasons: 

1.  The  Scholastic  Aptitude  Test  is  not  a  test  of  commonly  taught  or  needed 
skills.  The  verbal  test  is  a  cluster  of  reading  comprehension  paragraphs 
(commonly  required  skill)  and  a  test  of  abilities  to  recognize  antonyms  and 
find  analogies  (which  are  much  less  commonly  used  in  classrooms,  in  writing, 
or  in  life).  The  SAT  scores,  when  compiled  with  high  school  grades  and  rank 
in  class,  do  appear  to  predict  success  in  college  courses  Freshman  year.  They 
do  not  purport  to  measure  achievement  in  a  variety  of  skills  or  subjects. 

2.  The  SAT  yields  only  verbal  and  math  scores.  It  does  not,  even  in  the  verbal 
segment,  measure  writing,  speaking  or  listening  skills.  The  math  is  somewhat 
more  comprei^ensive  but  there  are  separate  College  Board  achievement  tests 
in  algebra*,  geometry,  calculus,  and  computer  sciences  beyond  what  the  SAT 
test  tries  to  measure.  In  addition,  the  SAT  does  not  evaluate  aptitude  in 
science,  foreign  language,  history,  health  and  other  important  subjects  or  skill 
clusters. 
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3.  A  different  percentage  of  high  schcx)i  students  take  the  test  in  each  state.  For 
example,  two  out  of  three  students  in  Connecticut  (63  percent)  take  the  SAT 
exams;  only  one  in  three  Texas  students  (33  percent)  take  the  test.  These 
variations  make  comparisons,  let  alone  rankings  of  the  state  or  conclusions 
about  quality,  impossible.  The  tests  were  designed  to  make  judgments  about 
each  student,  not  their  loc^!  schools  and  certainly  not  state  school  systems. 

<f.  State  SAT  scores,  which  are  now  ranked,  ignore  the  demographic  composition 
ol  each  state.  For  example.  New  Hampshire,  with  high  student  scores  on  the 
SAT's,  has  one  of  the  lowest  number  of  minority  students  in  the  n?*ion.  The 
1.3  percent  minority  are  mainly  associated  with  the  air  base  at  Portsmouth 
where  the  median  education  level  for  minority  parents  in  the  service  is 
actually  greater  than  that  of  the  white  adult  population  of  New  Hampshire. 
Also,  the  percentage  of  handicapped  students  of  New  Hamp:.  iire  is  only  thr'^e- 
fifths  that  of  Massachusetts  or  New  York.  New  Hampshire  has  no  large  cities, 
few  minorities,  and  fewer  than  average  handicapped.  This  may  explain  why, 
despite  higher  than  average  teacher-pupil  ratios  and  lew  state  support  for 
schools,  New  Hampshire  schools  and  academies  produce  comparatively  high 
scores.  State  SAT  scores  for  New  Hampshire  include  not  only  local  public  high 
schools  but  large  national  college  prep  schools  such  as  St.  Paul's  School 
(Concord)  and  Phillips  Exeter  Academy,  almost  all  of  whose  students  take  and 
often  score  very  high  on  the  SAT  test. 

The  SAT  was  never  designed  to  test  statewide  goals  or  provide  state-by-state  data. 
What  is  unacceptable  is  for  the  President  of  the  United  States  to  set  state  target 
scores  on  either  the  ACT  or  SAT  aptitude  tests  since  they  are  not  achievement 
tests  at  all  but  specialized  problem-solving  measures  useful  for  college  admissions 
decisions. 

The  "Performance  Outcome"  section  of  the  State  Education  Statistics  (January, 
1985)  prepared  by  the  Department  of  Education  planning  and  evaluation  service 
should  be  discontinued.  Let  the  College  Board  (and  ACT)  release  trend  data  as  they 
do  each  September  with  the  full  notes  about  cautious  interpretation.  Cancel  the 
publication  of  a  simplistic  Department  of  Education  wall  chart  that  does  not  suggest 
the  limits  of  the  test  instrument,  and  which  invites  spurious  comparison  of  unlike 
scores  by  the  states.  This  chart  serves  poorly  both  college  admission  and  national 
assessment  movement. 
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What  Should  NCES  Collect  and  Report? 

NCES  wisely  has  begun  the  search  for  alternative  indicators,  has  asked  dozens  of 
researchers  and  organizations  for  advice,  and  issued  contracts  to  at  least  one 
university  evaluation  center.  This  extensive  consultation  is  prudent  and  the  ideas 
produced  should  be  useful. 

I  would  like  to  suggest  certain  principles  to  guide  data  collection  activity: 

1.  The  data  should  be  useful  to  federal,  state  and  local  policymakers  or 
decision-makers.  Much  of  educational  research  and  assessment  does  not 
immediately  suggest  or  lead  to  the  development  of  a  course  of  action. 
However,  data  on  dropouts,  bilingual  education  graduates,  college-bound  or 
job-bound  students  by  occupation  is  very  useful. 

2.  The  amount  of  data  and  number  indicators  should  be  limited  to  that  which 
can  be  stored  and  analyzed  within  three  months  and  reported  to  policy- 

^  makers  within  the  year.   Local  and  state  school  systems  report  much  data 

to  the  federal  government  each  year  already  that  is  stored  but  not 
summarized  or  used  for  other  than  formal  report  compliance  purposes. 

3.  Data  should  be  drawn  xiom  sample  rather  than  total  populations.  The 
information  ordinarily  will  be  just  as  useful  and  the  cost  of  data  collection, 
especially  to  local  educators,  will  be  dramatically  reduced. 

Other  analysts/contributors  of  advice  to  NIE  will  explain  how  the  state  of  testing 
can  now  produce  unlimited  analyses  of  pupil  performance  on  a  thousand  measures. 
But  these  important  questions  should  be  asked:  Who  needs  it?  Who  will  use  it? 
For  what  purposes'*  These  are  deliberately  hard  questions,  and  they  should  be 
raised  repeatedly  about  the  entire  program  of  data  collection. 

The  state  profiles  and  "National  Report  Card"  should  reflect  a  consensus  among 
state  level  educators  as  well  as  educational  philosophers,  psychologists  and 
psychometricians  about  what  is  worth  knowing  about  the  schools.   State  agency 
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data  collectors  already  have  a  strong  sense  of  what  information  now  is  not  used, 
or  used  very  little  or  erroneously.  Heed  their  advice.  They,  each  and  all,  collect 
many  reams  of  reports  and  tapes  from  local  schools;  they  know  the  costs  and  can 
suggest  which,  if  any,  are  beneficial. 

What  would  be  useful  for  policymakers  to  know  is  student  achievement  in  grades 
*,  8,  and  11  or  12  in  these  subject  skills: 

Reading 

Writing  -  not  proofreading  but  a  composition  test 
Computation 

'  Computer  Skills  -  from  keyboard  to  programming 
Listening 

Foreign  Language 

Physical  Education  and  Fitness 

Music 

Art  appreciation 
Personal  health  and  safety 
History  and  government 
Citizenship 

Also,  it  is  important  to  know  these  indicators  on  a  state  by  state  basis: 

College  (or  postsecondary)  intentions,  and  actual  enrollment 
Job  placement,  including  Military 

Dropout  rates  -  by  age  and  grade  (with  a  common  definition) 
Handicapped  student  enrollment 

Bilingual  student  enrollment,  and  length  of  time  in  a  program. 

The  Secretary's  report  on  excellence,  A  Nation  At  Risk,  emphasized  the  "new 
basics"  which  were  really  the  traditional  academic  subjects  of  reading,  writing, 
mathematics,  science,  and  only  one  "new"  secondary  school  subject  —  computer 
studies. 
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The  Secretary's  recommendations  on  the  curriculum  were  too  limited.  For 
several  decades,  the  Council  on  Basic  Education  has  included  art,  music  and 
foreign  languages  (all  very  traditional  subjects  associated  with  the  cultivated, 
civilized,  well-educated  person)  in  their  definition  of  basic  history.  NAEP 
included  these  subjects  in  the  early  assessments.  The  College  Board  and  the  New 
York  Board  of  Regents  provides  achievement  tests  in  those  areas.  So  should  any 
rigorous,  systematic,  national  evaluation  of  education  in  the  United  States. 

One  caveat  about  computers.  Technology  may  be  a  more  appropriate  topic. 
Ernest  Boyer,  in  his  volume  High  School,  points  out  the  limits  to  teaching  skills 
or  computer  languages  that  may  be  obsolete  in  five  years.  More  so,  he  suggests 
that  the  study  of  machines,  of  systems,  of  the  history  and  limits  cf  technology 
is  of  more  enduring  importance.  If  so,  work  might  properly  begin  on  the  outline 
of  an  evaluation  strategy  for  the  1990's  in  a  world  of  fibre  optics,  laser 
technology,  artificial  intelligence,  and  genetic  engineering  in  which  computers 
play  a  major  role  but  not  the  only  one  worthy  of  systematic  study. 

^  Finally,  NAEP  in  the  early  years  measured  the  educational  attainment  of  young 

adults  (early  1920*s);  Since  some  youth  complete  high  school  at  night  or  during 
their  military  service,  these  data  are  part  of  the  full  picture  and  should  be  once 
again  collected  and  analyzed. 

Relevance,  Quality  and  Utility  of  Data  Collection  Activities 

Usually,  the  federal  government  collects  data  by  preparing  survey  instruments  which 
are  screened  by  one  or  more  committees  and  then  sent  out  to  local  schools,  often 
by  a  state  education  agency  whose  staff  helps  to  administer  and  monitor  federal 
education  programs.  This  is  typically  the  way  information  is  collected  on  vocational 
education,  handicapped  education  programs.  Chapter  One  basic  skill  programs,  food 
and  nutrition  programs,  and  other  services  where  the  state  and  local  responsibilities 
are  shared. 


On  several  occasions,  the  task  of  data  collection  and  analysis  has  been  assigned  to 
a  contractor  or  center  —  as  illustrated  by  the  use,  first,  of  the  Education 
Commission  of  the  States,  and  now.  Educational  Testing  Service  for  the  National 
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Assessment  of  Educational  Progress.  Also,  the  analysis  of  graduating  seniors  and 
their  subsequent  decisions  was  contracted  to  the  National  Opinion  Research  Center. 
These  are,  for  the  most  part,  appropriate  alternatives  to  surveying  state  and  local 
school  systems  directl>  for  data  on  educational  achievement  and  family  decisions. 

The  direct  burden  on  Jocal  school  systems  to  produce  reports  is  much  heavier  than 
either  researchers  or  federal  program  administrators  realize.  The  U.S.  has 
thousands  of  school  districts  with  a  few  schools  and  a  very  small  central  office 
consisting  of  a  superintendent  and  secretary,  possibly  a  business  manager.  Weeks 
of  work  go  into  the  preparation  of  periodic  reports^ 

As  a  chief  state  school  officer,  I  began  to  realize  that  local  school  officials  tended 
to  blame  the  state  since  the  survey  forms  and  envelopes  indicated  the  forms,  with 
few  exceptions,  must  be  returned  to  the  state  education  agency.  This  makes  sense 
because  each  state  needs  the  information,  and  states,  not  the  federal  government, 
have  the  constitutional  requirement  to  keep  track  of  local  school  resources  and 
activities.  But,  as  I  argued  in  an  article  entitled  "The  Federal  Takeover  of 
Education,"  the  federal  government  puts  up  5-10  percent  cf  the  funds  and  accounts 
for  50  percent  of  the  data  requests  of  local  schools.  Data  on  handicapped  children 
and  programs  on  vocational  education  are  among  the  most  complex,  voluminous  and 
time-consuming  surveys  to  complete. 

Since  leaving  the  state  education  office,  I  have  learned  that  local  educators  on 
occasion  will  meet  a  deadline  by  estimating  the  number  of  students  served  by  a 
program.  Rarely  would  anyone  deliberately  falsify  statistics,  even  if  the  flow  of 
dollars  depended  on  a  certain  number.  But  the  time  and  level  of  detail  is  difficult 
for  small  and  medium-sized  school  districts  and  cumbersome  for  the  large  districts. 

Other  issues  of  technical  quality  relate  to  definitions.  Student  dropout  rates  are 
defined  differently  by  the  several  states.  It  cannot  be  assumed  that  the  reported 
numbers  carry  the  same  meaning  from  state  to  state.  A  technical  task  force  of 
federal  and  state  educators  should  compile  all  of  the  definitions,  point  out  the 
contradictions  and  anomalies,  and  propose  a  consensus  position  for  the  state  boards, 
chief  state  school  officers  and  NCES  to  adopt. 
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Also,  the  federal  government  must  convene  a  group  which  would  standardize  the 
definition  of  handicapped  terms.  At  present,  the  same  words  carry  different 
meanings  in  these  agencies:    Office  of  Civil  Rights,  Vocational  Education,  NCE5, 


has  a  legitimate  need  to  know  how  many  students  are  both  bilingual  and 
handicapped).  A  few  states,  such  as  Massachusetts,  have  legislated  the  abolition  of 
handicapped  labels  which  tend  to  stigmatize,  denigrate  and  to  reduce  teacher 
expectations. 

However,  certain  federal  bureaus  and  offices  use  outmoded  or  differing  classifi- 
cation terins  which  make  tabulation,  comparison,  and  analysis  quite  difficult. 

The  issues  summarized  above  can  be  addressed  by  these  approaches: 

1.  Use  of  large  and  reputable  data  collection  and  analysis  services  for  complex, 
longitudinal  and  analytical  work  on  achievement  and  effects  of  educators; 

2.  Periodic  verification  of  local  and  state  data  as  reported  on  survey  forms; 

3.  Annual  reviews  of  data  reduction  options  and  possible  redundancies; 

4.  A  task  force  to  review  definitions  of  educational  conditions,  e.g.,  dropouts  and 
handicapped; 

5.  An  effort  to  obtain  a  uniform  federal  definition  of  handicapped  services  and 
programs. 

Data  Series  Important  to  Administrators 

In  my  tenure  as  a  state  superintendent,  I  needed  to  be  informed  about  pupil 
enrollment  trends,  school  closings,  consolidations,  and  emerging  shortages  of 
teachers  and,  eventually,  of  facilities. 

The  data  series  on  enrollments,  school  completions,  percent  in  non-public  school, 
length  of  school  term,  transportation  trends,  average  attendance  -  these  are  bread 
and  butter  statistics  needed  to  confirm  or  confront  the  conventional  wisdom  about 
school  needs  and  trends. 


Handicapped  Education,  Health  and  Human  Sei  vices,  and  Bilingual  Education  (which 
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For  example,  legislators  suggest  that  if  school  enrollment  is  declining  no  hew  funds 
are  needed.  Yet,  al!  over  America,  class  sizes  are  dropping  and  costs  of  education 
rising.  These  are  important  trends  for  education  advocates  and  legislative  analysts 
to  consider* 

Data  on  race  and  linguistic  background  are  important  to  administrators  of  bilingual 
programs  and  of  intergroup  or  intercultural  education. 

At  the  college  level,  the  information  on  earned  degrees,  placements  and  salaries  are 
important  to  institutional  planners  and  statewide  coordinators  of  higher  education 
programs. 

Information  on  tuition,  fees,  and  scholarship  awards  are  much  too  skimpy  given  the 
i.iiportance  of  federal  and  state  grant  and  loan  programs.  The  Congress  in  1980 
found  great  gaps  in  knowledge  about  these  higher  education  aid  programs  (which 
consume  $7  billion  dollars  or  almost  half  of  the  federal  education  budget  and  some  . 
funds  from  other  agencies  and  departments).  Subsequently,  Congress  created  a 
National  Commission  on  Student  Financial  Assistance  to  conduct  studies  and  collect 
data  which  NIE/NCES  might  have  reported.  Data  on  grant  recipients,  their  income 
levels,  their  race  and  sex,  their  completion  rates,  default  rates  -  all  of  these  are 
important  to  Congress  and  to  the.  states.  NCES  can  begin  by  reviewing  the 
questions  assigned  to  the  National  Commission  and  the  reports  filed  by  Commission 
staff  and  consultants,  many  of  which  should  be  collected  at  least  on  a  biennial  basis. 

On  the  whole,  this  commentator  believes  that  the  NCES  data  series  on  finance  and 
administration  fills  important  information  gaps  about  the  resources  made  available 
to  education  and  educators. 

Other  Measures  of  Educational  Productivity 

What  data  should  be  collected  other  than  achievement  data,  test  scores,  the 
percentage  passing  courses  or  graduating  from  high  school  or  college? 

Considerations  for  the  1990*s  include: 

1.  The  number  of  youth  who  participated  in  community  service  programs,  required 
or  voluntary,  should  be  tabulated.  The  Carnegie  Foundation  for  the  Advance- 
ment of  Teaching  has  advanced  this  proposal  which  some  high  schools  have 
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adopted.  This  120  hour  requirement  becomes  a  new  "Carnegie  UniV*  and  since 
NCES  maintains  the  scorecard,  it  is  important  to  add  this  tally  of  community 
service/  citizenship  education  requirenients. 

2.  The  amount  of  extra  or  co-curricular  activities  offered  by  U.S.  high  schools  and 
the  rate  of  student  participation.  For  fifty  years  the  textbooks  on  school 
leadership  have  agreed  that  students  learn  from  student  council  service,  from 
debate  club,  band  or  chorus,  basketball  and  soccer,  future  teachers  or  farmers, 
and  other  school  activities 

3.  The  numbers  of  handicapped  students  who  have  been  served  in  programs  (such  as 
those  funded  by  94-142)  and  who  have: 

a.  been  mainstreamed,  sent  to  less  restrictive  alternatives, 

b.  graduated  into  either  vocational  or  college  preparatory  programs, 

c.  become  gainfully  employed  or  enrolled  in  college. 

Now,  one  way  to  accomplish  this  is  to  engage  in  annual  surveys.  The  other  technique, 
potentially  even  more  useful,  is  the  periodic  study  of  "high  school  and  beyond,"  the 
systematic  sampling  of  school  graduates  and  their  subsequent  decisions  about  careers 
and  continuing  education. 

The  same  approach  pertains  to  bilingual  education  where  federal  and  state  policy- 
makers need  to  know  the  answers  to  these  questions: 

a.  How  many  bilingual  students  remain  in  school  and  graduate? 

b.  How  many  graduate  from  transitional  bilingual  education  classes  or 
programs? 

c.  What  is  the  level  of  linguistic  competence,  both  in  English  and  in 
another  language,  of  those  who  participate  in  bilingual  programs  for 
one  school  year  or  more? 
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A  strong  argument  has  been  advanced  for  broadening  the  role  of  the  National  As- 
sessment of  Educational  Progress  to  include  state  assessments  as  well.  NAEP  for 
several  years  has  offered  such  a  service  to  state  education  agencies.  Several  states, 
including  Minnesota  and  Connecticut,  have  made  extensive  use  of  the  data  col- 
lection format  and  many  other  states  have  obtained  test  items  or  subsections  of  the 
NAEP  instruments. 

NAEP  is  federally  funded,  and  one  option  is  to  add  funds  to  the  contract  to  enable 
all  states  to  be  included.    Two  of  the  major  concerns  will  be: 

1.  The  cost  of  this  expanded  survey,  especially  if  NAEP  requires  the  hiring  of 
local  test  administrators  as  is  the  current  practice,  and 

2.  Timeliness  of  the  reports,  especially  in  more  complicated  assessments  such  as 
on  writing  skills. 

The  issues  of  cost  and  timeliness  will  be  important  ones  to  address.  If  assessment 
is  too  labor-intensive  and  costly,  then  inevitably  some  components  important  to 
civilization  such  as  art  and  music  or  citizenship  education  will  be  elirr.inated. 

Also,  a  report  is  useful  to  decision-makers  if  results  are  available  within  six  to  ten 
weeks  —  such  as  the  College  Board  and  ETS  can  provide  to  college  admissions 
officials.  According  to  some  long-term  participants  in  NCES  and  state  education 
decision-making,  the  NAEP  state  survey  data  can  take  a  year  or  more  to  analyze 
and  report.   A  more  timely  analysis  would  presumably  cost  more  money. 

Does  NAEP  need  to  cost  more  money  to  obtain  state  results?  Three  tasks  must  be 
undertaken: 

1.      Legislators  and  chief  state  school  officers  should  comment  on  the  usefulness 
of  the  information  produced  by  NAEP.   Which  findings  or  results  are  merely 


132 

124 


( 

interesting,  and  which  provide  data  and  analyses  on  which  local  and  state 
decision-makers  can  act? 

2-  State  education  agency  staff  should  be  asked  whether  NAEP  should  hire  and 
assign  test  administrators  for  each  local  assessment  site.  In  carrying  out  an 
assessment  (an  inventory  of  their  educational  progress)^  Illinois  found  that  the 
expensive  practice  of  assigning  an  assessment  administrator  was  unnecessary. 
Illinois  assessment  results  without  the  local  assessment  administrators  were 
not  significantly  different. 

3.  The  speed  of  analysis  and  reporting  must  be  timed  to  a  decision-making  cycle, 
to  the  planning/budgeting  cycles  of  states  (which  vary)  or  to  either  a  federal 
reauthorization  or  budget.  Data  must  be  current  —  which  is  one  reason  why 
the  annual  SAT  score  reports  attract  so  much  attention. 

If  not  NAEP,  there  remains  the  alternative  of  asking  the  larger  state  agencies  to 
agree  on  common  achievement  data  collection  or  at  least  a  common  core  of  testing 
and  evaluation  activity.  The  Council  of  Chief  State  School  Officers  has  begun  this 
work  and  NCES/Department  of  Education  should  strongly  support  this  effort.  It  is 
quite  possible  that  assessment  activity  by  a  coalition  of  state  educational  agencies 
can  be  more  cost-effective,  more  useful  and  more  comprehensive  than  NAEP  at 
present. 

This  argues  against  an  early  decision  (1986)  on  a  single  ten-year  format  for  state- 
by-state  assessments.  The  Department  has  already  made  serious  errors  in  publishing 
state  SAT  and  ACT  scores.  The  Department  should  consult  with  state-based  groups, 
especially  the  legislators  and  chiefs  and  state  boards  of  education.  States  do 
respond  to  incentives,  to  capacity-building  grants,  and  to  cost-sharing  programs. 
The  state  appetite  for  assessment  data  has  grown  enormously  in  the  1980's,  well 
ahead  of  any  scientific  consensus  on  how  to  evaluate  education  sensitively  and 
thoroughly.  This  is  an  example  of  how  federalism  can  work,  a  sharing  of  state  and 
national  resources. 

What  seems  highly  desirable  is  an  agreement  to  use  the  energy  and  commitment  of 
the  CouncU  of  Chief  State  School  Officers  to  agree  on  common  indicators  of 
(  educational  progress.    Such  a  consultation  should  include  the  tests  of  comprehen- 

siveness, cost-effectiveness,  and  usefulness  to  state  as  well  as  federal  policymakers. 

^  125 

ERIC  133 


DATA  ON  TEACHERS  AND  TEACHING: 
OPENING  THE  BLACK  BOXES  OF  EDUCATION 


Linda  Darling-Haaunond 
The  Rand  Corporation 
Washington,  D.C.  20037 


October  198S 


This  paper  was  prepared  for  the  Elementary  and  Secondary  Data  Redesign 
Project  of  the  National  Center  for  Education  Statistics. 


126 


134 


( 


ERIC 


Over  the  last  fifteen  years,  ever-declining  funding  for  educational 
research  and  data  collection  has  left  us  with  many  tempting  clues  but 
little  solid  evidence  about  what  is  actually  occurring  in  the  nation's 
schools.    Annual  reports  on  student  test  scores  from  the  National 
Assessment  of  Educational  Progress,  the  College  Boird,  and  individual 
states  and  school  districts  lead  predictably  to  hand-wringing  or  back- 
patting  on  the  part  of  educators  and  policymakers;  but  comparable, 
insightful  trend  data  about  the  school  and  classroom  conditions  leading 
to  these  fluctuations  is  most  noticeable  by  its  absence  from  discourse 
about  policy  and  practice.    It  simply  is  not  available. 

That  we  do  not  have  a  national  ongoing  system  of  educational 
indicators  has  become  apparent  during  these  last  few  years  of  commission 
reports  on  the  status  of  American  schooling.    Armed  with  evidence  of 
declining  test  scores,  the  various  commissions  have  sought  to  make 
recommendations  for  reform  based  on  analyses  of  the  problems  which  have 
had  to  rely  on  old  data,  non-comparable  data,  and  noniterative  cross* 
sectional  data.   .The  lack  of  detailed,  regularly  collected  trend  data  on 
important  aspects  of  education— school  finances  and  programs,  teaching 
practices  and  methods,  and  teacher  qualifications  and  assignments,  among 
others "-has  forced  policymakers  and  analysts  to  intuit  the  causes  of 
educational  "problems**  (themselves  poorly  defined)  and  to  infer  from 
these  intuitions  what  steps  should  be  taken  in  response. 

By  treating  the  substance  of  schooling- -what  happens  between  the 
time  that  policymakers  set  budgets  and  mandates  and  the  time  that  test 
companies  take  their  thermometer  scores--as  a  black  box,  we  can  never 
know  which  one(s)  of  any  number  of  policy,  practice,  and  environmental 
factors  are  producing  the  effects  we  applaud  or  deplore  in  the  all- 
too-habitual  cycle  of  educational  **crisis,'*  reform,  disillusionment,  and 
neglect  leading  to  the  next  wave  of  crisis,  reform,  etc.    The  potential 
dangers  of  this  approach  to  educational  policymaking  are  exacerbated  by 
the  vigor  with  which  state  and  local  agencies  have  taken  up  the 
challenge  to  initiate  reform,  and  by  the  public  thirst  for  numbers  to 
characterize  educational  progress.    Where  meaningful,  defensible 
indicators  of  educational  conditions  are  absent,  anything  that  has  been 
quantified  will  do,  and  these  (sometimes  conflicting)  numbers  are 
bandied  about  with  reckless  abandon,  adding  great  heat  but  little  light 
to  serious  deliberations  about  reform.    The  Secretary* s  wall  chart  of 
state  comparisons  is  but  one  example  of  data  that  have  been  so  misused; 
there  are,  of  course,  other  less  well-known  but  equally  damaging 
examples . 

In  this  paper,  I  would  like  to  address  two  areas  of  data  collection 
which  I  believe  are  most  critical  to  understanding  the  conditions  of 
education:    data  about  teachers  and  about  the  content  and  methods  of 
teaching.    Let  me  begin  by  justifying  these  choices.    Some  years  ago, 
studies  of  schooling  were  dominated  by  input-output  methods,  wherein 
gross  measures  of  inputs  (expenditures,  class  size,  number  of  library 
books  per  student,  etc.)  were  regressed  on  gross  measures  of  outcomes 
(test  scores,  years  of  schooling  completed,  etc.)  to  ascertain  what 
**works**  to  produce  educational  achievement.    The  answers  were  not 
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clearcut,  in  part  I  would  argue,  because  those  aspects  of  schooling  that 
most  influence  the  interactions  between  students  and  teachers  were 
ignored.    In  fact,  the  main  product  of  this  approach  was  a  decade  of 
debate  over  whether  schools  had  any  independent  effects  on  outcomes  at 
all.    Nonetheless 9  these  studies  stimulated,  for  a  brief  ^ime,  large* 
scale  data  collection  on  the  specified  variables  of  interest,  at  least 
allowing  examination  of  possible  relationships  and  knowledge  of  trends. 

For  &  variety  of  reasons,  perhaps  including  (but  certainly  not 
limited  to)  the  failure  of  the  approach  to  explain  differences  in 
schooling  outcomes,  detailed  information  about  school  resources  and 
expenditures  ceased  to  be  available  at  the  national  level  after  th^  late 
1970s.    Research  efforts  since  then  have  focused  on  school  and  classroom 
level  variables  that'  seem  under  certain  circumstances  to  produce  changes 
in  student  achievement.    TWo  "bodies"  of  this  research  have  been  labeled 
as  "teaching  effectiveness"  and  "school  effectiveness"  research.  These 
sets  of  studies  point  to  some  generic  features  of  school  climate  and  of 
teaching  behaviors  that,  in  some  instances --primarily  in  elementary 
schools  serving  disadvantaged  students**seem  to  be  associated  with 
increased  achievement  on  standardized  tests  of  "basic"  skills.  While 
closer  to  the  nexus  between  students  and  teachers,  these  studies  have 
still  not  included  in  any  systematic  way  the  characteristics  of  teachers 
or  the  content  of  teaching  as  variables  for  examination. 

I  will  not  treat  here  the  issu^  related  to  the  validity  and 
generalizability  of  these  studies'  results--there  is  a  burgeoning  and 
contentious  literature  on  the  subject---but  will  make  two  points 
concerning  the  Implications  of  this  research  for  data  collection:  (1) 
State  and  local  education  policymakers  are  seizing  on  these  results  as 
the  basis  for  policy  initiatives  (e.g.,  school  Improvement  programs, 
teacher  evaluation  systems  based  on  "effective  teaching"  behaviors, 
remediation  programs  for  students  who  have  failed  competency  tests),  yet 
we  have  no  cross-cutting  data  sources  for  estimating  the  degree  to  which 
these  "effectiveness"  variables  are  present  or  absent  across  schools  of 
various  types,  much  less  to  examine  the  claims  for  their  potency;  and 
(2)  these  and  other  efforts  to  understand  schools  "from  the  inside  out" 
have  been  limited  by  the  lack  of  nationally-representative  data  about 
what  goes  on  In  schools  and  classrooms. 

Now  we  find  ourselves  faced  with  at  least  two  widely-nimored  and 
much-accepted  presumptions  about  the  current  state  of  education:  that 
educational  quality  has  declined  and  that  there  is,  or  will  be,  a 
sizable  shortage  of  skilled  teachers.    Some  analysts  are  even 
presumptuous  enough  to  speculate  that  there  may  be  a  link  between 
educational  quality  and  the  characteristics  of  teachers  and  teaching. 
And  some  policymakers  are  developing  policies  based  on  these 
presumptions.    It  is  even  possible  that  a  better  understanding  of  trends 
affecting  the  characteristics  of  teachers  and  teaching  may  provide  some 
links  between  the  deductive  and  inductive  streams  of  research  which  have 
as  yet  failed  to  meet  on  a  common  ground.    Yet  these  presumptions  and 
possibilities  cannot  at  present  be  tested  with  the  kinds  of  data  that 
are  collected  in  either  an  iterative  or  longitudinal  fashion  across  a 
representative  range  of  students  and  schools. 
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The  opportuni  .    costs  of  continued  failure  to  collect  data  that 
describe  trends  in  the  teaching  force  and  in  the  substance  of  teaching, 
I  would  argue,  are  quite  large,  particularly  at  this  juncture  in 
history.    Educational  policymaking  is  increasingly  tampering  with  the 
"irnards"  of  schools,  rather  than  merely  fiddling  at  the  periphery  of 
school  operations.    Without  an  ongoing  set  of  educational  indicators 
that  describes  salient  aspects  of  teaching,  we  w'll  never  be  able  to 
understand  and  reconcile  the  discrepant  findings  that  result  from  either 

black  box"  analyses  or  microscopic  examinations  of  schooling  in  unique 
settings.    We  will  consign  educational  policymaking  to  its  traditional 
faddism  in  response  to  problems  that  are  poorly  understood. 

THE  NEED  FOR  DATA  ABOUT  TEACHERS 

Spotty  evidence  about  two  recent  trends  have  produced  a  waft  of 
legislation  concerning  teacher  education,  certification,  and 
compensation  across  the  states.    The  first  consists  of  data  suggesting 
that  the  academic' ability  of  those  choosing  to  teach,  and  remaining  in 
teaching  after  a  few  years,  may  be  declining  (Weaver,  1979,  19fl;  Vance 
and  Schlechty,  1982;  NCES,  1983).    The  second  consists  of  data 
suggesting  that  the  number  of  prospective  teachers  will  soon  be 
insufficient  to  meet  the  demand  for  new  teachers,  and  that  substantial 
shortages  will  result  (NEA,  1983;  NCES,  1980,  IS^^I).    Although  this 
evidence  is  based  on  the  best  data  currently  available,  the  data  are 
inadequate  to  firmly  establish  the  existence  or  magnitude  of  these 
probable  trends  and  are  even  1       adequate  to  provide  a  diagnosis  of  the 
problem  which  could  assist  poj.  /makers  in  formulating  solutions. 

Because  there  are  pc^entially  important  interactions  between  tbo 
supply  and  quality  of  teaching  candidates,  a  proper  diagnosis  of  tie 
reasons  for  observed  or  projected  shortages  is  essential  for  policy 
formulation.    The  traditional  responses  to  short  supply  of  job 
applicants.  In  teaching  and  elsewhere,  are  either  to  raise  salaries  to 
increase  the  pool  of  individuals  willing  to  offer  their  services  to  an 
occupation  or  to  lower  standards  for  entry,  or  some  combination  of  both. 
The  strategy  followed  depends  on  the  degree  to  which  timely  warning  of 
Impending  shortage  allows  for  policy  responses  which  maintain  standards 
as  well  as  the  degree  to  which  existing  standards  are  viewed  as  useful 
predictors  of  job  performance.    In  education  right  now,  it  is  probably 
fair  to  say  that  there  is  little  agreement  on  the  types  of  policy 
responses  which  will  allow  maii&tenance  of  quality  standards  in  the  face 
of  at  least  spot  shortages  or  on  the  usefulness  of  the  standards  that 
currently  exist.    Thus,  we  see  states  both  tightening  and  loosening 
certification  and  entry  standards  (sometimes  both  simultaneously),  and 
making  various  adjustments  In  compensation  at  different  junctures  in  the 
teaching  career  with  little  abi^lity  to  predict  how  these  changes  will 
affect  the  supply  of  teachers  or  the  quality  of  teaching. 

At  least  two  competing  theories  are  now  offered  for  the  presumed 
declines  in  teacher  supply  and  quality.    Weaver  (1978,1979),  for 
example,  has  argued  that  decreased  demand  for  teachers  during  the  1970s 
led  to  a  decline  in  the  quality  of  supply  as  schools  of  education 
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attempted  to  maintain  enrollments  by  lowering  their  standards.     If  this 
theory  is  correct »  increased  demand  should  of  itself  increase  the  supply 
of  potential  candidates,  and  tighter  certification  and  entry  standards 
should  increase  quality.    In  contrast,  Schlechty  and  Vance  (1981)  argue 
that  e>7«wsion  of  non*teaching  employment  opportunities  for 

traditional"  prospective  teachers  has  caused  a  decrease  in  the  supply 
and  quality  of  teaching  candidates,  as  many  have  been  lured  away  to 
other  fields  with  greater  financial  and  nonpecuniary  attractions.  If 
this  theory  Is  correct,  the  only  way  to  Increase  teacher  supply  without 
lowering  standards  (or  to  maintain  standards  without  further  decreasing 
supply)  win  be  to  increase  the  attractions  to  teaching. 

To  test  these  (or  other)  theories  about  how  the  size  and 
composition  of  the  prospective  teaching  pool  evolves,  we  need  data  about 
how  occupational  choice  decisions  are  made  by  college  students  and  how 
these  decisions  translate  into  actual  employment  decisions  after 
graduation.    However,  to  estimate  the  effects  of  various  policy 
alternatives  on  overall  supply  and  demand  we  also  need  to  know  about  the 
size  and  character  of  the  reserve  teaching  pool,  the  conditions  under 
which  Its  members  will  offer  their  services  to  education,  the 
determinants  of  teacher  attrition,  and  the  degree  to  which  certain 
teacher  attributes  or  skills  are  interchangeable  when  shortages  exist  In 
some  teaching  fields  while  surpluses  exist  In  others.    Models  for 
projecting  teacher  supply  and  demand  must  Incorporate  not  only  these 
kinds  of  data,  but  also  take  Into  account  policy-generated  changes  In 
demand  and  policy -generated  definitions  of  shortages  which  rest  on 
conceptions  of  which  characteristics  of  teachers  are  essential  and  which 
are  dispensable  for  filling  certain  kinds  of  teaching  positions. 

The  definition  of  shortage  as  something  more  than  a  count  of 
unfilled  vacancies  is  most  essential  if  we  are  to  move  beyond  a  warm- 
body  theory  of  teacher  quality.    Although  measures  which  take  into 
account  teacher  certification  or  college  coursework  preparation  move  us 
further  toward  some  notion  of  supply  which  Incorporates  a  quality 
dimension,  the  knotty  Issues  of  what  knowledge  and  skills  are  Important 
to  teaching  will  ultimately  require  data  on  teaching  practices  matched 
to  data  on  teacher  preparation  if  we  are  to  begin  developing  an 
understanding  of  how  policies  relating  to  teacher  supply  influence  the 
actual  content  and  outcomes  of  teaching.    And,  as  I  have  argued  above, 
until  we  begin  to  understand  what  actually  occurs  in  classrooms,  we  will 
never  solve  the  riddles  posed  by  incomplete  models  of  school  effects 
whlch^  first  stimulate  and  later  dampen  reform  initiatives.    Below  I 
propose  some  of  the  most  essential  data  collection  efforts  I  believe  are 
necessary  to  begin  sketching  out  trends  concerning  teachers  and 
teaching,  which  might  someday  lead  to  answers  to  perennial  policy 
dilemmas. 

Taachar  Supply 

Projecting  teacher  supply  requires  knowledge  of  at  least  three 
sources  of  potential  supply; 
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1.  The  number  of  current  teachers  expected  to  remain  in  the 
teaching  force  at  a  given  point  in  time  (the  required  estimate 
of  attrition  is,  of  course,  also  a  component  of  projected 
demand) ; 

2.  The  number  of  college  graduates  expected  to  choose  teaching  as 
their  initial  occupation.    (For  long-range  projections,  we 
should  also  consider  the  proportion  of  these  who  are  expected 
to  remain  In  teaching  by  year  X  or  Y); 

3.  The  number  of  individuals  qualified  to  teach  who  are  currently 
not  teaching  but  might  return  to  teaching,  i.e.,  the  potential 
reserve  pool. 

None  of  these  estimates  Is  simple  to  derive,  and  currently 
available  data  sources  are  inadequate  for  each.    To  complicate  matters 
further,  local  or  regional  supply  estimates  must  take  account  of  In-  and 
out-migratlon  fxom  the  labor  market  area.    Field-specific  estimates  must 
take  account  of  substitution  possibilities  among  teachers  in  different 
teaching  areas.    Putting  aside  these  additional  data  requirements  for 
the  moment,  let  us  examine  how  well  we  can  handle  the  basic  task  of 
projecting  supply  with  current  information. 

The  first  component,  the  stock  of  current  teachers  minus  attrition, 
ought  to  be  the  simplest  to  estimate  and  project.    However,  though  the 
number  of  current  teachers  is  known,  current  and  prospective  attrition 
rates  are  not.    The  most  recent  estimate  of  teacher  attrition  was 
obtained  by  NCES  in  1969.    This  estimate  of  6  percent  has  been  used  ever 
since  in  NCES  projections  of  teacher  supply  and  demand. 

There  are  a  number  of  reasons  to  believe  that  teacher  attrition 
rates  are  not  static.    First,  the  age  composition  of  the  teaching  force 
changes  over  time;  hence,  the  proportion  of  the  force  nearing  retirement 
also  changes.    In  addition,  recent  data  from  a  number  of  states  and 
school  districts  suggest  that  attrition  rates  are  especially  high  (50 
percent  or  higher)  for  inexperienced  teachers  during  their  first  few 
years  (cf  Mark'  and  Anderson,  1985;  Grissmer  and  Darling-Hammond,  1984; 
Vance  and  Schlechty,  1982).    Thus,  the  epcperience  composition  of  the 
teaching  force-'^also  related  to  the  age*dlstrlbutlon-~may  be  an 
Important  (and  changing)  variable.    Third,  labor  market  forces  in 
teaching  and  in  the  general  economy  undoubtedly  influence  turnover. 
When  teaching  positions  are  scarce,  temporary  exits  may  be  fewer  dut»  to 
expected  difficulty  in  re-entering;  when  other  opportunities  are 
plentiful,  career  changes  are  more  likely «    (These  opportunities  may 
also,  of  course,  be  more  plentiful  in  some  regions  of  the  country  and 
for  teachers  in  certain  flelds*-*especlally  math,  science,  and  computer 
sclence--than  others.) 

Finally,  policy  variables  may  influence  attrition  rates. 
Incentives  for  early  retirement,  for  example,  became  widespread  in 
school  districts  during  the  1970s,  when  declining  enrollments  required 
reductlons-ln-force.    These  incentives  may  now  work,  ironically,  to 


131 

139 


produce  shortages.    Current  policy  Initiatives,  such  as  internships  for 
beginning  teachers  and  merit  pay  or  career  ladders  for  veterans ,  are 
intended  to  influence  attrition  rates.    Perhaps  they  will. 

Suffice  it  to  say  that  we  should  expect  attrition  to  change  with 
the  shape  of  the  teaching  force,  with  the  health  of  other  sectors  of  the 
economy,  and  perhaps  even  with  changes  in  policy  affecting  teachers.  We 
ought,  then,  to  be  prepared  to  regularly  estimate  attrition  rates  for 
various  classes'  of  teachers  as  a  basis  for  preparing  and  modifying 
projections  of  extant  supply. 

As  a  first  step,  we  need  to  know  the  age  composition  of  the  current 
teaching  force  and  attrition  rates  by  age  category,  so  that  we  can 
project  the  number  of  retirements  and  early  leavers  over  time.    It  is 
im*^  rtant  to  note  that,  as  new  teachers  comprise  a  greater  share  of  the 
tBL  .ing  force  in  the  coming  years,  it  will  be  more  important  to 
understand  when  and  why  many  of  them  leave,  and  whether  they  plan  to 
returr.    Currently  the  NCES  Common  Core  Data  Set  tabulates  state  counts 
of  full-time  equivalent  teachers  by  level,  but  not  by  age,  experience, 
or  teaching  field.    The  periodic  NCES  surveys  of  teacher  demand  and 
shortage  collect  data  from  a  sample  of  school  districts  on  total 
teaching  positions  by  field  and  on  vacancies  and  new  hires,  but  do  not 
allow  accurate  estimates  of  attrition.    New  sources  of  data  must  be 
developed  if  these  information  needs  are  tc  be  met. 

While  surveys  of  school  districts  oi  schools  cculd  be  developed  to 
provide  estimates  of  localized  turnover  rates  and  probably  fairly 
accurate  estimates  of  retirement,  they  would  need  to  be  supplemented  by 
ongoing  surveys  of  teachers  if  mobility  among  districts  is  to  be 
accurately  separated  from  temporary  and  "permanent"  leaves  from  the 
profession--and  if  reasons  for  leaving  are  to  be  iinderstood. 

In  addition,  both  district-level  and  teacher-level  surveys  should 
collect  data  that  will  allow  analysis  of  policy  factors  that  might 
influence  both  entry  and  retention  in  teaching.    At  a  minimum,  salary 
data  must  be  collected  from  districts  (through  the  CCD  and/or  other 
district  surveys)  that  describe  the  salary  range  and  distribution  of 
teachers  across  that  range  in  addition  to  average  salaries,  which  are 
uninformative  for  most  analytic  purposes.    Information  on  retirement 
plans  and  other  important  compensation  variables  would  also  be  helpful 
for  analysis  of  attrition  rates.    Cluster  sampling  of  te    hers  within 
districts  to  establish  career  paths  and  plans  could  further  illuminate 
links  to  policy  variables,  especially  if  these  surveys  could  iJiclude 
information  on  teachers'  views  of  the  policies  as  they  influence  career 
dec is ions. 

The  second  component  of  supply,  entrants  who  are  recent  college 
graduates,  is  also  problematic.    Traditionally,  estimates  of  new  teacher 
supply  have  been  made  on  the  basis  of  the  number  of  students  graduating 
with  degrees  in  education.    Although  data  are  now  routinely  collected 
which  provide  such  estimates  at  the  bachelor's  and  master's  degree 
levels,  and  these  are  incorporated  into  HCES  projections*,  there  are 
problems  with  using  this  measure  alone  to  estimate  and  project  new 
teacher  supply. 
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First,  we  need  to  know  what  proportion  of  master's  degrees  granted 
in  education  are  awarded  to  persons  preparing  to  teach  as  opposed  to 
those  already  teaching.    Previous  inclusion  of  master's  degree  students 
in  estimates  of  new  supply  have  caused  overestimates;  exclusion  will 
lead  to  underestimates  of  unknown  proportions.    While  in  the  past,  the 
vast  majority  of  such  master's  degrees  were  awarded  to  existing 
teachers,  this  may  change  as  states  open  up  alternative  routes  to 
certification  for  liberal  arts  graduates  and  as  some  teacher  education 
programs  move  to  a  5*year  model. 

Second,  we  need  to  know  what  proportion  of  students  receiving 
bachelor's  degrees  in  education  actually  plan  to  teach,  and  how  many  do 
so.    Prior  NCES  surveys  of  recent  college  graduates  have  obtained  such 
data;  however,  they  do  not  provide  information  about  the  degree  to  which 
failure  to  enter  teaching  is  due  to  inability  to  find  Jobs  or  to  changes 
in  occupational  plans.    Clearly  such  Information  is  needed  if  we  are  to 
understand  the. real  sources  of  supply. 

The  proportions  of  teacher  education  graduates  who  do  not  initially 
enter  teaching  vary  substantially  over  time  and  across  teaching  fields. 
In  1976-77,  NCES  estimated  that  the  portion  of  newly  qualified  graduates 
seeking  teaching  positions  was  77  percent,  with  only  60  percent 
ultimately  accepting  teaching  positions.    In  1981,  the  estimate  of  those 
seeking  full-time  positions  was  85  percent,  with  64  percent  ultimately 
accepting  such  positions.    Differences  among  teaching  fields  are  also 
substantial.    In  1981,  for  example,  only  30  percent  of  prospective 
health  teachers  accepted  full-time  teaching  Jobs  as  compared  to  75 
percent  of  prospective  special  education  teachers  (NCES,  1983) 

Previous  studies  have  tended  to  overestimate  new  teacher  supply 
because  of  lack  of  data  about  occupational  decisionmaking  both  during 
and  immediately  after  college.    One  consistent  source  of  overestimates 
in  projections  has  been  the  assumption  that  the  teacher  production  rate 
is  a  constant  share  of  the  college  student  population.    In  fact  between 
about  1970  and  1980,  the  proportion  of  college  students  majoring  in 
education  declined  by  nearly  half--*from  21  percent  to  11.6  percent-- 
and  the  proportion  of  college-bound  students,  now  planning  to  major  in 
education  is  only  about  5  percent.    Thus,  projections  of  teacher  supply 
must  incorporate  tr0ttds  in  the  occupational  choicemaking  behavior  of 
students.    These  trend  data  are  useful  only  if  they  are  understood.  To 
what  extent  are  substantial  changes  in  teacher  production  rates  a 
response  to  labor  market  factors  (i.e.,  a  perceived  surplus  of 
teachers)?    To  what  extent  are  they  evidence  of  disaffection  with  the 
salaries  or  other  conditions  of  teaching? 

The  relationship  between  educational  and  occupational  plans  and 
actions  must  be  examined  at  several  points  in  the  teacher  production 
pipeline  if  we  are  to  understand  the  factors  influencing  the  supply  of 
new  teachers:  at  college  entry,  choice  of  major,  college  exit,  and 
initial  occupational  choice.    As  mentioned  earlier,  the  decision  to 
leave  or  remain  in  teaching  during  the  first  few  years  is  also  extrec^ly 
important.    The  NLS  supplement  to  be  conducted  next  spring  that  will 


survey  all  of  those  in  the  1972  sample  who  ever  majored  in  education  or 
taught  (plus  a  sample  of  those  who  might  otherwise  be  classified  as 
prospective  teachers)  will  provide  a  valuable  data  source  for  examining 
these  questions  for  that  cohort  of  students.    NCES  should  consider 
adding  a  small  number  of  carefully-designed  questions  to  the  HSB 
followups  of  1980  sophomores  and  seniors  to  track  their  occupational 
decisionmaking  with  respect  to  teaching  as  well. 

The  third  source  of  .teacher  supply--the  potential  "reserve  pool"  of 
teachers --is  most  difficult  to  estimate,  but  may  be  increasingly 
important  if  the  number  of  new  college  graduates  entering  teaching 
continues  to  shrink.    These  are  individuals  who  are  qualified  to  teach 
but  who  are  not  currently  teaching,  either  because  they,  perhaps 
temporarily,  left  teaching  to  raise  families  or  pursue  more  education, 
or  because  they  have  entered  other  occupations.    Estimating  the  '^ize  of 
the  real  reserve  pool  depends  on  knowing  what  proportion  of  these 
individuals  would  consider  re-entering  teaching  under  various  conditions 
as  well  as  knowing  the  annual  rates  of  entry  into  and  exit  from  the 
pool*    Previous  studies  have  tended  to  overestimate  the  annual  supplies 
from  the  reserve  pool  since  an  overprojection  of  the  number  of  new 
teachers  produced  in  any  year  results  in  an  overprojection  of  tie  size 
of  the  reserve  pool  in  subsequent  years  and  because  "attrition'  from  the 
reserve  pool  (into  other  occupations)  is  not  taken  into  account.  Even 
with  better  estimates  of  annual  supply ,  we  will  need  data  chat  allows  us 
to  identify  the  factors  that  influence  the  behavior  of  exteachers  and 
their  relative  propensities  to  seek  teaching  positions. 

There  are  several  possibilities  for  collecting  such  data;  though 
each  is  imperfect,  they  would  provide  us  more  information  than  we  now 
have.    The  special  NLS  survey  of  current  and  former  teachers  will 
provide  some  information  on  the  current  occupational  status  of  former 
recruits  to  teaching  and,  perhaps,  on  their  plans  and  attitudes  toward 
re*entering  teaching.    Sincd  this  is  a  single  cohort,  though,  it  will 
provide  limited  information  on  responses  to  different  labor  market 
conditions  and  on  attitudes  of  later  cohorts.    Nonetheless,  the  survey 
should  provide  strong  indications  of  the  numbers  and  characteristics  of 
the  "potential"  reserve  pool  for  that  cohort  who  are  in  fact  firmly 
committed  to  other  occupations  and  lost  to  teaching.    Sipsilar  followups 
with  the  HSB  sample  would  strengthen  the  analysis  of  reserve  pool 
behavior.    In  addition,  ongoing  surveys  of  teachers  might  be  designed  to 
solicit  personal  and  Job  histories  from  those  who  have  Just  entered  or 
re-entered  teaching  and  Job  plans  from  recent  attritees  (if  they  are 
tracked)  or  those  who  have  definite  plans  to  leave  during  the  school 
year.    These  efforts  would  help  in  developing  estimates  of  both  entry 
and  exit  rates  from  the  reserve  pool  for  different  types  of  teachers  and 
an  understanding  of  the  factors  influencing  these  decisions. 

Teacher  Demand 

To  estimate  and  project  teacher  demand  we  need  to  know  the  number 
teaching  positions  required  in  a  given  year  (by  field  and  level),  and 
..6  number  that  will  be  filled  by  teachers  currently  in  the  teaching 
force.    The  first  component,  the  size  of  the  teaching  force,  depends  at 
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the  most  general  level  on  student  enrollments  and  anticipated 
pupil/teacher  ratios ,  both  of  which  are  fairly  easy  to  estimate  with 
existing  demographic  and  school  data.    Projection  errors,  though,  can 
stem  from  at  least  two  sources: 


1.  Inability  to  anticipate  student  enrollment  growth  due  to  such 
factors  as  immigration  (which  may  cause  dramatic  increases  in 
enrollment  In  some  regions  or  localities)  or  changes  in  student 
service  patterns,  caused  by  policies  that  extend  public 
education  downward  to  kindergarten  and  preschool  levels  as  is 
occurring  now  in  some  states. 

2.  Inability  to  anticipate  policy-generated  changes  in  staffing 
patterns >  such  as  those  which  accompany  new  forms  of  service 
delivery  (e.g.,  the  now  fairly  widespread  use  of  specialists  in 
elementary  schools  or  the  possible  changes  in  staff 
responsibilities  that  may  accompany  career  ladder  plans);  or 
new  programs  and  course  requirements  for  students  (e.g.,  the 
addition  of  special  education,  bilingual  education,  and 
compensatory  education  programs  during  the  1970s,  or  the 
changes  in  student  graduation  requirements  now  being  enacted  in 
many  states). 

These  kinds  of  changes  certainly  affect  the  demand  for  particular 
types  of  teachers;  depending  on  how  schools  iranage  these  changes,  i.e., 
the  degree  to  which  they  substitute  or  supplement  teachers  and 
services),  they  affect  the  total  demand  for  teachers  as  well. 

There  are  at  least  two  possible  means  for  improving  sources  of  data 
about  these  elements  of  teacher  demand.    First,  it  may  be  possible  to 
include  questions  about  recent  policy  changes  presumed  to  affect  teacher 
demand  in  the  CCD  surveys  of  state  education  agencies  and  in  the  Demand 
and  Shortage  surveys  of  local  education  agencies.    While  officials  may 
not  be  able  to  estimate  the  effects  of  recent  policy  changes  on  teacher 
demand,  the  availability  of  other  state-  and  local-level  data  about 
student  participation  in  the  relevant  courses,  programs,  or  services 
might  allow  analysts  to  do  so. 

At  a  minimum,  though,  collecting  such  information  would  allow  some 
gross  adjustment  of  demand  projections  if  used  in  conjunction  with  a 
second  source  of  data:    regular  reports  of  teacher  vacancies  in 
particular  fields  which  separate  new  demand  from  demand  produced  by 
attrition*    The  periodic  surveys  of  teacher  demand  and  shortage  are  not 
currently  designed  to  provide  this  information,  although  the  addition  of 
a  few  questions  would  allow  them  to  do  so.    Specifically,  the  surveys 
need  to  ascertain  the  number  of  teaching  positions  (by  level  and  field) 
authorized  for  the  current  year  as  compared  to  the  number  authorized  and 
filled  in  the  previous  year  (now  not  asked),  along  with  the  number  of 
continuing  teachers,  new  hirees,  and  unfilled  vacancies.  Adding 
questions  about  student  enrollment  trends  and  pupil/teacher  ratios  would 
also  allow  much  more  accurate  understanding  of  the  sources  of  demand. 
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The  second  component  of  demand,  the  number  of  continuing  teachers, 
was  treated  in  the  previous  section's  discussion  of  teacher  attrition. 
One  additional  observation  is  important  here.    The  degree  to  which 
teachers  with  different  skills  and  preparation  are  substitutable  when 
new  areas  of  demand  emerge  has  important  implications  for  assessing  both 
overall  and  field-specific  demand  and  shortage.    Much  of  the 
disagreement  over  current  shortage  projections  stems  from  lack  of 
clarity  on  this  point « 

Teachttr  Shortage 

As  an  example  of  how  definitions  of  teacher  shortage  vary,  consider 
two  extreme  views  of  teacher  fungibility.    On  the  one  hand,  if  teachers 
of  different  backgrounds  are  always  perfect  substitutes  for  one  another 
(e.g*,  an  elementary  school  teacher  can  as  easily  teach  high  school 
mathematics  and  a  junior  high  industrial  arts  teacher  can  as  easily 
teach  kindergarten) ,  then  estimates  of  total  teacher  supply  and  total 
teacher  demand  are  all  that  count.    If  supply  equals  or  exceeds  demand, 
and  is  projected  to  continue  to  do  so,  there  is  little  cause  for  concern 
about  shortages «    (Obviously,  local  and  regional  imbalances  in  total 
supply  6md  demand  are  important  and  will  vary«    Some  excess  in  supply  is 
always  necessary  to  force  mobility  to  places  with  higher  demand  and  to 
allow  quality  distinctions  to  be  made  in  hiring.) 

In  fact  this  is  the  basic  approach  of  most  general  projections  of 
teacher  supply  and  demand,  which  further  assume  that  anyone  who  is 
teaching  (or  haa  taught)  can  be  couinted  as  a  teacher,  i«e«,  part  of  the 
supply  pool,  regardless  of  qualifications «    This  assumption  stems  from 
the  lack  of  agreement  about  what  constitutes  qualification  to  teach, 
leading  to  non-discriminating  measures  for  counting  teachers  that 
reflect  states^  and  school  districts*  willingness  to  hire  individuals 
without  standard  credentials  as  teachers  when  the  need  arises  or  to 
reassign  current  teachers  outside  their  areas  of  preparation*  These 
then  become  part  of  the  teacher  pool,  and  it  becomes  almost  impossible 
to  discern  a  shortage,  since  vacancies  are  nearly  always  filled  somehow 
with  someone*    The  analogy  would  be  to  calculate  in  the  supply  of 
physicians  anyone  willing  to  offer  his  or  her  services  as  a  doctor, 
regardless  of  training  or  licensure,  in  an  environment  where  significant 
bars  to  this  practice  did  not  exist*    Thus,  the  recent  surveys  of 
Teacher  Demand  and  Shortage  report  few  "shortages as  measured  by 
unfilled  vacancies,  while  projections  based  on  qualifications  to  teach 
have  'anticipated  shortages  and  surveys  of  teachers  suggest  that  a 
nontrivial  proportion  teach  outside  theix  fields  of  preparation  or 
certification* 

At  the  other  extreme,  if  we  assume  that  teachers  are  totally  non* 
fungible  and  that  particular  preparation* -however  defined--is  essential 
for  successful  performance  of  the  job,  i*e.|  that  a  teacher  can  only 
teach  those  subjects  or  levels  for  which  they  have  particular 
preparation,  then  supply,  demand,  and  shortage  would  be  assessed  ouch 
•differently*    Separate  computations  of  supply  and  demand  by  field  would 
be  essential,  with  acute  shortages  obvious  in  soiue  and  surpluses  obvious 
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in  others,  and  individuals  hired  or  assigned  to  teach  in  areas  for  which 

they  lack  the  particular  qualifications  used  as  a  discriminating  measure 

would  be  eliminated  from  counts  of  "legitimate"  supply,  thus  producing 
measures  of  latent  if  not  blatant  shortages. 

Obviously,  taken  to  the  extreme  these  assumptions  can  become 
equally  nonsensical,  and  NCES  cannot  become  the  final  arbiter  of  teacher 
quality  measures.    However,  some  indication  of  the  degree  to  which  the 
uemand  for  specific  types  of  teachers  is  matched  with  a  supply  of 
appropriately-trained  teachers  is  essential  for  policymakers  concerned 
with  teacher  supply  and  quality.    Given  that  there  is  disagreement  about 
measures  of  teacher  quality,  several  different  measures  could  be  used  in 
data  collection  efforts  that  describe  the  stock  of  teachers  and  their 
teaching  assignments.    These  might  include  certification  in  the  field(s) 
taught,  college  coursework  preparation  in  those  fields,  and  pedagogical 
preparation.    Such  indicators  would  at  least  allow  policymakers  to  track 
supply,  demai^d,  and  shortage  according  to  various  definitions  of 
"legitimate"  supply.    They  would  also  allow  some  means  for  reconciling 
currently  disparate  estimates  and,  ultimately  perhaps,  for  examining  how 
school  districts'  hiring  and  assigrment  practices  influence  ether 
teaching  variables  of  interest. 

Although  data  are  not  available  to  demonstrate  conclusively  how  • 
qualifications-related  measures  of  supply  and  demand  would  affect 
estimates  of  shortages,  some  sense  of  the  possible  magnitude  of 
diff  rences  in  estimates  derived  from  alternative  assumptions  can  be 
gained  from  recent  surveys.    The  1983-84  NCES  estimates  of  teacher 
shortage,  based  on  a  measure  of  unfilled  vacancies  reported  by  a  sample 
of  school  districts,  indicate  overall  shortages  in  the  neighborhood  of 
only  1.6  per  thousand  current  teachers,  with  f ield*specif ic  shortages 
ranging  from  .4  per  thousand  for  reading  to  8.8  per  thousand  for 
bilingual  education  (NCES,  1985).    This  range  probably  reflects  supply 
as  it  interacts  with  the  outer  bounds  of  teacher  "fungibility"  in 
different  fields.    That  is,  a  number  of  individuals  might  well  be  viewed 
as  capable  of  teaching  reading,  but  the  potential  supply  of  bilingual 
education  teachers  is  limited  to  individuals  who  are,  in  fact,  bilingual 
themselves,  aside  from  the  application  of  any  credentialing  standards. 

Applying  a  different  standard  leads  to  quite  different  estimates  of 
shortage.    For  example,  the  same  1983-84  survey  provided  estimates  of 
the  proportion  of  total  and  newly  hired  teachers  not  certified  in  their 
principal  field  of  assignment;  these  amounted  to  3.4  percent  of  all 
teachers  and  12.4  percent  of  all  newly  hired  teachers.    If  we  assumed 
that  no  certified  applicants  could  be  found  to  fill  the  vacancies  filled 
by  newly  hired  uncertified  teachers  and  added  these  26,300  positions  to 
the  count  of  unfilled  vacancies,  the  estimate  of  shortages  would 
increase  dramatically  from  1.6  to  over  20  per  thousand  current  teachers. 
If  we  further  assumed  that  the  positions  filled  by  other  teachers 
assignee  outside  their  fields  of  certification  could  not  have  been 
filled  by  certified  app licants  (for  various  reasons  this  becomes  a  more 
dubious  assumption),  the  estimates  would  skyrocket  further. 
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Applying  still  mor')  rigorous  standards  yields  predictably  larger 
estimates.    Since  certification  is  not  a  perfect  measure  of 
preparation, [1]  we  might  want  to  know  what  proportion  of  teachers  are 
teaching  classes  outside  their  fields  of  preparation  that  might 
otherwise  be  counted  as  evidence  of  demand  cr,  if  unfilled,  of  shortage. 
(Again,  this  requires  inferences  about  hiring  and  staffing  and 
disallowances  of  substitutions  or  economies  that  are  not  entirely 
supportable.)    A  1980*81  NEA  survey  of  teachers  indicates  that  16 
percent  of  all  teachers  teach  some  classes  outside  their  field  of 
preparation;  and  9  percent  spend  most  of  their  time  teaching  "out  of 
field"  (NCEA,  1981);  the  HSB  survey  indicates  that,  among  high  school 
teachers,  11  percent  teach  primarily  outside  their  area  of  state 
certification  and  17  percent  have  less  than  a  college  minor  in  the  field 
they  most  frequently  teach  (Carroll,  1985). 

To  be  sure,  we  do  not  know  the  degree  to  which  such  "out  of  field" 
assignments  are  actually  inappropriate  according  to  various  standards, 
or  the  degree  to  which  they  impair  teaching  quality;  nor  do  we  know  the 
extent  to  which  the  discontinuation  of  some  of  these  types  of  hiring  and 
assignment  practices  would  actually  influence  teacher  demand  or 
shortage.    Some  of  these  practices  are  undoubtedly  the  result  of 
capitalizing  on  teachers'  individual  uncredentialed  abilities  and 
interests;  some  result  from  district  attempts  to  continue  to  employ 
senior  teachers  when  demand  in  their  particular  teaching  fields 
declines;  some  are  probably  supported  by  inservice  training  that 
upgrades  the  stock  and  flexibility  of  human  capital.    On  the  other  hand, 
misassignment  as  a  response  to  teacher  shortages  may  also  result  in  poor 
teaching  in  some  unknown  proportion  of  instances,  and  may  contribute  to 
teacher  stress  and  Attrition. 

In  order  to  understand  the  interactions  between  teacher  supply  and 
qualifications  and  the  effects  of  qualifications  on  teaching  practice, 
we  need  data  from  ongoing  surveys  of  teachers  to  supplement  the  data  on 
teacher  hiring  and  vacancies  collected  from  school  district  personnel 
offices.    The  latter  are  useful  for  providing  gross  measures  of  shortage 
and  qualifications,  but  cannot  provide  details  about  teachers' 
characteristics  and  attributes  or  about  teaching  practice.    Through  the 
preceding  discussion,  I  have  described  certain  kinds  of  information 
needed  to  understand  important  aspects  of  supply  and  demand  that  can 
only  be  collected  from  teachers,  and  must  be  obtained  on  a  regular 
basis.    Ongoing  surveys  of  teachers  such  as  those  launched  in  the  Public 
and  Private  School  Teacher  Surveys  of  1984*85,  should  be  designed  to 
collect  data  on  teachers  formal  qualifications,  additional  inservice 
training;  teaching  assignments  and  Job  histories  and  plans. 
Furthermore,  as  described  below,  these  surveys  should  collect  data  on 
teachers*  attitudes  and  teaching  practices  so  that  policy^related 
questions  concerning  the  links  between  school  and  teacher  variables  can 
be  examined. 


[l]The  HSB  survey  of  high  school  teachers,  for  example,  indicates 
•that  of  the  small  number  (1.7  percent)  of  high  school  teachers  who  have 
had  no  college  courses  in  the  field  they  most  frequently  teach,  74 
percent  are  nonetheless  certified  in  that  field  (Carroll,  198S). 


( 


{ 


c 

ERIC 


THE  NEED  FOR  DATA  ON  TEACHING 

Currently,  very  little  data  are  available  on  teachers'  working 
conditions,  their  vie^/s  of  school  conditions  and  administrative 
practices,  or  on  the  activities  they  engage  in  as  part  of  their 
instructional  efforts •    The  only  ongoing  source  of  information  providing 
trend  data  on  teachers'  working  conditions,  career  plans,  and  views  of 
teaching  is  collected  every  five  years  (since  1956)  by  the  National 
Education  Association,  in  the  Status  of  the  American  Public  School 
Teacher  surveys.    For  the  first  time,  the  1985  NCES  Public  and  Private 
School  Teacher  Sur\ iys  asked  questions  about  teacher  qualifications, 
teaching  load  and  salaries,  but  there  are  no  comparable  questions  about 
career  plans  and  satisfaction  with  which  to  test  links  between  working 
conditions  and  career  decisions.    Future  surveys  of  teachers  conducted 
by  NCES  ought  to  seek  data  on  all  of  the  these  variables  on  a  regular 
basis  so  that  possible  relationships  between  teacher  qualifications, 
compensation  and  work  load,  views  of  working  conditions,  and  career 
decisions  can  be  examined. 

Still  less  data  are  available  about  what  teachers  actually  do  in 
classrooms,  much  less  how  teaching  practices  relate  to  teacher 
attributes  or  school  policies.    Though  studies  of  school  and  teacher 
effectiveness  have  suggested  a  number  of  policy  and  practice  variables 
that  are  important  to  schooling  outcomes,  no  nationally-representative 
source  of  data  on  chese  factors  is  available  to  examine  trends  or 
relationships.    The  addition  of  teacher  and  administrator  questionnaires 
to  the  HSB  student  surveys  is  a  commendable  start  for  understanding  the 
experiences  of  high  school  students.    NAEP's  efforts  in  this  direction 
will  also  enrich  our  understanding  of  schooling  processes  for  the  NAEP 
samples  of  students,  teachers,  and  administrators.    However,  the 
usefulness  of  these  data  for  various  policy  purposes  is  limited  by  the 
nature  of  the  sampling  frames  appropriate  to  their  major  purposes. 

A  tantalizing  peek  at  changes  in  teaching  practices  was  provided  by 
the  major  longitudinal  studies  data  on  high  school  seniors  reports  of 
teaching  methods  used  in  their  classrooms.    Between  1972  and  1980, 
students  were  exposed  to  writing,  student«centered  discussions,  and 
project  or  laboratory  work  in  their  public  school  12th  grade  classrooms. 
More  were  exposed  to  individualized  instruction  and  computer^assisted 
instruction.    Unfortunately,  the  data  did  not  allow  further  examination 
of  teaching  practices  or  their  relationship  to  teacher  attributes  or 
school  policies.    And,  of  course,  no  such  data  are  available  for 
examining  teaching  practices  at  other  grade  levels. 

Among  the  major  questions  about  teaching  for  which  we  have  no  trend 
data  available  are  the  following: 

o     How  much  instructional  time  is  available  to  students  and 
teachers  (e.g.,  length  of  the  school  day  and  school  year; 
duration  of  classroom  periods)? 


o     How  do  teachers  use  instructional  time  (e.g.,  amount  of  time 
devoted  to  different  subject  areas  and  to  different  teaching 
activities  such  as  lecturing,  discussion,  seatwork,  project  or 
lab  work,  recitation,  testing,  reading,  writing)? 

o     How  much  instructional  time  is  lost  to  "nonteaching"  activities 
(e.g.,  paperwork,  pep  rallies,  class  changes)? 

o     How  much  emphasis  do  teachers  place  on  different  instructional 
tools  or  methods  in  classroom  and  homework  assignments  (use  of 
textbooks,  workbooks,  computers,  teacher-developed  materials, 
library  books,  research  projects  or  other  problem-solving 
activities,  writing  themes,  etc.)? 

o     How  do  teachers  make  decisions  about  what  and  how  to  teach 
district  or  school  policy,  textbook  coverage,  test  coverage, 
personal  views  of  student  needs,  etc.)? 

Data  on  teaching  variables  such  as  the  above,  if  gathered  from 
teachers  sampled  in  clusters  by  school  and  district  emd,  if  combined 
with  administrative  data  on  policies  and  school/student  characteristics, 
would  allow  analysis  of  how  policy  and  environmental  factors  influence 
teaching  practice;  how  teacher  characteristics — including  qualifications 
and  experience  in  the  teaching  area- -influence  practice;  and  how 
practices  change  over  time.    It  is  beyond  the  mission  of  NCES  to 
establish  how  any  or  all  of  these  variables  affect  student  leaming-- 
other  kinds  of  research  and  data  collection  activities  sponsored  by  NIE 
and  elsewhere  must  attend  to  these  quest ions --but  as  knowledge  grows 
about  important  indicators  of  effective  schooling  and  teaching,  NCES 
should  strive  to  incorporate  sources  of  relevant  .data  in  a  stable, 
ongoing  system  of  teacher  and  administrator  surveys  that  reveal 
something  of  what  actually  occurs  in  those  black  boxes  called  schools. 

This  effort  will  require  greater  amounts  of  resources  than  have 
been  available  to  NCES  in  recent  years.    However,  the  resources  required 
are  negligible  compared  to  the  millions  of  dollars  expended  on  the 
thousands  of  commission  meetings  and  papers  and  other  activities 
attendant  to  reform  formulation  which  sweep  the  country  each  time  a  new 
crisis  in  education  is  declared.    Though  NCES  cannot  relieve  us  of 
crises  and  commissions,  it  can  provide  a  basis  for  deliberations  about 
problem  sources  and  solutions  which  might  advance  the  debate,  and 
perhaps  eventually  break  the  cycle  of  educational  crisis,  reform, 
disillusionment,  and  neglect  which  is  repeated  with  such  distressing 
regularity. 
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Introduction 

The  National  Center  for  Education  Statistics  (NCES)  seeks  to 
redesign  Its  data  collection  efforts  to  Improve  the  quality  and 
utility  of  the  data  for  decisionmakers  and  the  general  public. 
For  this  to  occur,  three  goals  must  be  met.    First,  the  choxce  of 
what  data  to  collect  must  be  driven  by  the  questions  of  interest 
to  decisionmakers  and  the  public.    Second,  procedures  must  be  in 
place  that  insure  the  data  are  valid  and  reliable.    Third,  the 
data  must  be  reported  in  ways  that  facilitate  use  by  the  intended 
audiences. 

For  NCES,  the  second  goal  is  the  most  critical.  Careful 
choices  about  what  data  to  collect  and  clear  reporting  cannot 
compensate  for  inaccurate  data.    Below  I  first  comment  on  data 
accuracy  and  then  discuss  reporting,  citing  examples  from 
Indicators  of  Education  Status  and  Trends  (January  1985).     I  then 
list  specific  comments  on  Indicators  of  Education  Status  and 
Trends  with  page  references. 


Data  Accuracy 

The  biggest  challenge  facing  NCES  is  that  of  insuring  the 
validity  and  reliability  of  the  data  they  rc^port.    if  the  data 
continue  to  be       Inaccurate  in  the  future  as  the^  have  in  the 
past,  all  other  Issues  are  moot.    The  more  levels  of  aggregation 
the  data  pass  through,  the  more  sources  for  arror.    Because  NCES 
must  rely  on  second,  third,  and  fourth  hand  data^  it  is  essential 
to  put  Into  place  a  set  of  procedures  designed  to  check  the 
veilidity  and  reliability  of  the  data. 

Given  the  need  to  rely  on  data  from  other  sources 
{particularly  state  administrative  data  which  are  notoriously 
inaccurate),  NCES  must,  at  the  least,  develop  a  system  that 
permits  crosschecking  the  data  with  other  sources  for  the  same 
information.    Ju^fglng  frou  the  description  of  current  data 
sources,  it  appears  that  there  are  multiple  sources  of  data  for 
certain  types  of  information  (e.g.,  data  on  staffing  and  teacher 
characteristics  reported  by  the  states  are  also  collected  in 
NCES*8  Public  School  Survey).    To  the  extent  that  multiple  data 
sources  already  exist,  NCES  should  make  comparisons  across  data 
sources  and  report  on  both  the  extent  to  which  discrepancies  are 
found  and  plausible  explanations  for  the  di^^^repancies.  NCES 
should  exploit  all  opportunities  to  corroborate  data  sources  over 
which  they  have  little  direct  control,  suet,  as  state 
administrative  data  and  Census  data. 

Data  for  which  multiple  sources  do  not  currently  exist 
should  be  collected  through  alternative  means  designed  explicitly 
as  a  crosscheck.    The  Fast  Response  Survey  System  could  readily 
Le  adapted  to  this  end.    Of  course,  this  presumes  that  care  is 
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taken  to  ask  precise  questions.     Unfortunately,  my  only 
experience  with  NCES  Fast  Response  Survey  data  suggests  that 
the^e  data  are  often  Inaccurate  c.s  well.     On  the  one  occasion  in 
which  I  used  these  data  (1979),  my  own  telephone  surveys 
corroborated  by  fl<»ld  work  produced  figures  quite  different  from 
those  of  NCES  (e.g.,  NCES  reported  66  schools  In  California 
participating  in  the  Schoolwlde  Projects  Provision  of  what  was 
then  ESEA  Title  I;  I  located  107  such  schools). 

Perhaps  NCES  could  also  establish  samples  of  schools  within 
states  (If  such  a  sample  does  not  exist)  as  an  extension  of*  the 
Fast  Response  Survey  System.     NCES  could  also  build  Items  Into 
contracted  longitudinal  studies  for  purposes  of  corroborating 
other  data  sources.     In  addition,  NCES  should  be  aware  of  other 
national  data  collection  efforts  (particularly  federally  funded 
studies  In  education,  labor,  and  health  and  annual  surveys  such 
as  Gallup,  Louis,  etc.)  and  develop  agreements  for  sharing  data 
with  the  funding  or  dat-  collection  agency. 


Reporting 

Given  the  nature  of  the  data  to  be  collected,  and  the 
reliance  on  Indirect  sources  and  multiple  levels  of  aggregation, 
there  will  always  be  Issues  of  validity  and  reliability. 
However,  NUES  can  take  steps  (a)  to  maximize  validity  and 
reliability  and  (b)  to  Inform  readers  of  the  weaknesses  that 
remain. 

In  reporting  the  data,  It  Is  absolutely  essential  to  have 
Indicators  of  the  validity  and  reliability  of  the  data.    As  a 
user  of  data,  I  aun  always  suspicious  of  any  type  of  survey  data 
or  compilation  across  levels  of  government.    However,  when  I  know 
how  the  question  was  asked,  I  can  draw  my  own  conclusions  about 
the  bias  of  the  responses.    When  I  know  the  sample  size  and  a 
standard  deviation  or  a  confidence  Interval,  I  can  draw  my  own 
conclusions  about  Its  credibility  and  utility.  Through 
television  and  other  media,  even  lay  audience ;8  are  accustomed  to 
confidence  Intervals  and  other  Indicators  of  measurement  error. 

Based  on  a  close  reading  of  the  Indicators  of  Education 
Status  and  Trends,  I  urge  NCES  to  consider  the  following 
recommendations  for  reporting  the  data  In  addition  to  reporting 
how  questions  were  asked  and    estimates  of  reliability. 

1)  Following  the  previous  recommendations  for  corroborating 
data,  reported  data  should  Include  a  brief  description  of 
the  similarities  and  discrepancies  from  different  sources 
and  an  analysis  of  what  accounts  for  the  differences.  To 
the  extent  that  the  discrepancies  Influence  interpretation 
of  the  data,  the  text  should  alert  the  reader  to  the  limits 
on  Interpretation. 
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2)  When  multiple  sources  are  cited,  as  is  currently  the  case 
for  many  of  the  tables  and  charts  in  Indicators  >  indicate 
how  the  multiple  sources  were  used«     Multiple  sources  always 
suggests  to  me  that  data  were  merged  without  regard  to 
comparability.     When  multiple  sources  are  cited,  note  which 
data  came  from  which  source  and,  If  two  sources  were  merged 
for  one  estliuate,  describe  how  and  why  this  was  done. 

3)  Precise  descriptions  of  what  the  numbers  represent  and 
Interpretations  of  how  their  known  weaknesses  Influence  the 
results  Is  crucial.     Some  Inaccuracy  Is  Inevitable  In  such  a 
mammoth  system  of  data  collection.    No  one  expects 
otherwise.     The  utility  of  the  data  rests  on  attaining  an 
acceptable  level  of  quality  and  alerting  the  reader  to  Its 
remaining  weaknesses.    Unfortunately,  the  text  In  Indicators 
accomplishes  neither  of  these  goals.    Sloppy  table  titles 
and  categoi /  labels  are  Inexcusable  as  Is  vague  and 
ungrammatlcal  prose.     (See  examples  below.)    Readers  must 
understand  the  limits  of  the  data. 

4)  Knowledgable  Interpretation  of  data  Is  useful  to  readers; 
uninformed  or  sloppy  Interpretation  Is  dangerous.  NCES 
should  provide  Interpretation  but  not  without  a  system  that 
corroborates  the  Interpretatlon(s) .    One  approach  Is  to 
create  panels  of  outside  reviews  In  different  areas  (e.g., 
one  for  student  performance,  another  for  human  resources) 
who  would  comment  on  a  draft  of  the  presentation.  Agreement 
Is  not  essential;  presenting  conflicting  Interpretations  Is 
also  extremely  useful  to  readers. 

5)  Collect  and  report  the  data  In  ways  that  minimize 
Inappropriate  comparisons.    For  example,  comparing  states  by 
comparing  trends  over  time  within  states  decreases  the 
problems  due  to  different  measures  and  definitions.  NCES 
do^s  this  well  In  several  places.     In  addition,  the  text 
around  tables  and  charts  should  draw  the  readers'  attention 
to  the  appropriate  comparisons. 

6)  NCES  should  cite  data  sources  more  accurately  and  fully. 
When  "NCES  estimates"  are  cited  as  the  data  source,  my 
eyebrows  go  up.    All  sources  should  Include  dates. 

7)  Use  the  glo^« try  to  help  readers.    Dictionary  definitions 
of  enrollment,  attendance  and  biology,  for  example,  are  not 
helpful.    The  Glossary  should  reflect  the  way  questions  were 
asked  and  Indicate  differences  In  definitions  across  states 
or  data  sources. 


Comments  on  "Indicators" 

The  concept  of  a  report  on  Indicators  of  education  status 
and  trends  Is  excellent.    This  kind  of  annual  report  has  the 
potential  to  provide  an  Invaluable  picture  of  our  educational 
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system  over  time.    At  the  least.  It  provides  a  backdrop  against 
which  to  Interpret  other  data  and  educational  Issues  at  all 
levels — national,  state  and  local.    At  the  most,  the  data  can 
Inform  the  public  and  policymakers  about  expected  trends  In  such 
critical  areas  as  teachers  supply  and  student  enrollment. 

Recognizing  that  the  January  1985  Indicators  of  Education 
Status  and  Trends  Is  a  first  attempt  which  seeks  reactions  from 
potential  users,  I  offer  the  following  specific  reactions  by 
report  section  and  page. 


Outcomes 

p.  3      I  find  the  NAEP  data  by  assessment  area  within  subject 
particularly  Illuminating.    I  realize  presenting  subscales 
greatly  Increases  the  quantity  of  the  data.    This  is  an  Instance 
In  which  some  clear  text  around  the  tables  would  be  useful.  The 
text  could  report  conclusions  from  an  Inspection  of  more  detailed 
tables  and  reference  other  publications.     (A  minor  point: 
describing  shifts  In  performance  "over  the  past  decade  or  so**  Is 
misleading,  especially  for  science  which  Includes  no  data  from 
the  past  eight  years.) 

p.  6      I  don't  know  what  to  conclude  from  these  data.    How  were 
these  topics  measured?    Old  the  Items  correspond  to  a  particular 
curriculum?    Old  they  emphasize  computation  or  problem  solving? 
Are  the  numbers  medians  of  18  means?    Oo  the  results  look 
different  If  the  comparison  Is  between  the  United  States  and  the 
five  countries  with  the  same  proportion  enrolled  in  math? 

p.  8      Because  this  Is  an  area  In  which  many  states  are  changing 
their  requirements,  it  would  be  useful  to  see  shifts  over  time 
and  a  breakdown  by  state.    Are  these  only  comprehensive  high 
schools? 

p.  10    This  Is  an  Instance  In  which  how  the  question  was  asked 
and  to  whom  Is  critical.    Can  GEDs  be  reported  separately?  (It 
Isn^t  clear  whether  they  are  Included  on  p.  10  or  not). 


Resourcsrs 

p.  24    Basing  pupil/teacher  ratios  on  all  Instructional  staff 
results  In  a  gross  underestimate  of  class  size.    Readers  will 
draw  from  this  table  an  Image  that  severely  distorts  reality. 
These  data  must  be  presented  for  teachers  with  regular  classroom 
assignments  or  not  at  all.    There  Is  no  Indication  of  what  the 
sample  Is  for  the  class  size  data;  are  they  based  on  regular 
teachers  only? 
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Why  is  the  research  literature  mentioned  here  and  not 
elsewhere?     If  research  is  mentioned,  there  should  be  complete 
citations.     I  don't  think  It  belongs  here;  an  adequate  summary  Is 
difficult  to  do  In  one  sentence. 

"In  1971  and  subsequent  years,  the  data  by  level  are 
estimated."    The  footnote  should  say  how  and  why  the  estimates 
were  made.     Citing  "unpublished  data  and  estimates"  only  Invites 
suspicion. 

p.  26-27    The  headings  and  labels  for  the  table  on  p,  26  are  a 
good  Illustration  of  the  need  to  use  precise  language.     The  title 
is  extremely  misleading;  this  Is  not  a  table  about  the 
distribution  of  academic  ability  In  the  teaching  force. 
Throughout  the  present  report,  typically  the  charts  on  the  right 
are  far  easier  to  understand  than  the  tables  on  the  left.  This 
is  partly  because  graphs  are  often  easier  to  grasp,  but  more  due 
to  the  clarity  of  the  titles  a  .d  headings.    The  title  and  labels 
of  the  graph  are  much  more  precise  and  hence  clearer  than  those 
on  the  left.     (E.g.,  Percent  Scoring  In  Highest  Fifth  Is  much 
clearer  than  Highest  Ra:ik  with  a  footnote  saying  the  sample ^was 
broken  Into  five  ranks). 

The  content  of  these  two  pages  also  raises  questions. 
First,  It  Is  unconscionable  to  refer  to  these  data  as  measures  of 
the  "Quality  of  the  Teaching  Force."    No  single  test  score  can 
capture  teacher  quality.    Moreover,  given  the  small  percent  of 
teachers  who  take  the  SAT  (and  no  Indication  of  this  In  the 
table),  I  conclude  that  the  numbers  are  extremely  misleading.  I 
have  no  problem  with  the  Idea  of  looking  at  teacher  performance 
on  academic  measures,  but  I  need  to  be  convinced  that  these  data 
speak  to  that  Issue.    Perhaps  this  Is  an  Instance  In  which  the 
National  Longitudinal  Study  Is  not  the  best  source  of  data. 
(The  samples  seem  quite  small.) 

p.  28    For  data  about  teacher  supply  and  demand  to  be  useful, 
they  need  to  be  reported  separately  for  elementary  and  secondary 
school  and  by  subject  area.     It  would  also  be  useful  to  see  these 
figures  by  region  and  '':he  same  breakdowns  for  teachers  "teaching 
out  of  subject" — that  Is,  teaching  in  fields  for  which  they  are 
not  certified.    The  table  doesn't  state  that  the  entries  are  in 
thousands . 


p.  37    Do  data  on  teachers'  perceptions  of  problems  exist  over 
time?    The  wording  of  the  second  bullet  suggests  that  the 
Metropolitan  Life/Harris  Survey  was  conducted  in  other  years  as 
well.     It  would  be  useful  to  see  trends  in  these  data.    Were  the 
questions  posed  to  the  public  and  to  teachers  in  the  same  way? 
If  not,  since  the  tables  invite  comparisons,  it  would  be  useful 
to  know  how  they  differ. 


Context 


p.  38    Certainly  school  environment  Indlcattr^  are  of  Interest. 

However,  the  key  factors  associated  with  effective  schools  are  ) 

not  amenable  to  the  kind  of  measurement  that  could  be  aggregated 

across  schools  and  districts  and  states.    Mjst  of  us  don't  even 

know  how  to  measure  them  on  site.    The  kinds  of  perceptions  to  be 

reported  in  the  1984  follow-up  for  High  School  and  Beyond  may 

prove  useful.    I  suspect  that  the  greatest  utility  will  lie  in 

the  items  that  have  been  asked  over  time.  '  As  with  trends  withJn 

state,  shifts  over  time  are  easlar  to  interpret  than  absolute 

levels  of  factors  like  ""environment  conducive  to  student 

achievement."    This  suggests  a  critical  need  for  ongoing 

longitudinal  studies  of  this  type. 

p.  40    How  many  students  actually  receive  these  various  types  of 
services? 

p.  42  Nhere  are  the  data  cited  in  the  text  on  pages  42  and  43? 
To  estimate  school  enrollment  trends,  are  census  data  available 
on  numbers  of  babies/children  ages  0-3? 

p.  44    Referring  to  state  required  Carnegie  units  as  "State 
Governance"  seems  odd. 


Additional  data  that  I  would  find  useful  include! 

-median  age  of  teachers  by  state 
-data  on  preschool  attendanca 
-measures  of  student  mobility/ turnover 

-information  on  number  of  hours  worked  (and  types  of  Jobs) 
for  high  school  students  by  state  and  minority  statias 


Looking  to  the  Future 

The  proliferation  of  microcomputers  in  district  offices  and 
schools,  combined  with  growing  sophistication  about  and  access  to 
telecommunications,  has  far  reaching  implications  for  future  data 
collection.    Now  is  not  the  time  to  implement  such  a  system; 
neither  access  to  the  technology  nor  user  sophistication  is 
sufficiently  widespread.    But  now  is  the  time  to  begin  to  design 
a  computerized  data  collection  system  utilizing  the 
telecommunications  capability  that  most  districts  and  schools 
will  have  within  a  decade  or  less.    Such  a  system  will  require 
considerable  planning  and  testing;  waiting  until  the  technology 
is  completely  in  place  will  put  NCES  a  decade  behind.    If  General 
Motors  can  design  a  system  that  automatically  translates  an 
Individual  customer's  order  into  Instructions  for  what  parts  to 
manufacture  and  into  a  ctistom  made  car,  NCES  ought  to  be  able  to 
gather  basic  descriptive  information  about  our  schools  through 
similar  applications  of  technology. 

The  second  application  of  technology  that  NCES  should  now  be 
investigating  is  the  use  of  microcomputers  for  different  kinds  of 
assessment  Instruments.    The  limits  of  paper  and  pencil  tests  are  ) 
well  known.    Designing  new  measures  that  go  beyond  simple 
multiple  choice  questions  should  be  underway. 
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As  we  proceed  Into  the  1980*s  and  Into  the  1990*s,  our  public  schools 
In  the  big  cities  or  urban  areas  will  become  even  greater  proportionally 
minority  and  poor.    The  needs,  aspirations  and  ability  of  this  poor  and 
minority  population  in  our  big  cities  will  require  the  development  of  new 
sources  for  data  collection  because  the  traditional  measures  used  to  collect 
data  on  this  population  have  proved  to  be  most  inaccurate.    Inaccurate  data 
on  this  population  has  far  reaching  consequences  for  the  future  of  America 
when  they  lead  to  policy  decisions  which  address  problems  that  no  longer 
exist,  problems  that  are  not  adequately  defined  and,  in  too  many  cases, 
problems  that  never  existed.    As  well  intended  as  these  policy  decisions 
might  be,  our  country,  with  resources  now  scarce,  cannot  direct  and  use 
these  resources  by  chance  and  in  far  too  many  instances  use  them  to 
aggravate  problems. 

What  is  the  d3t%  which  will  prove  to  be  of  the  most  value  to  persons 
working  in  the  trenches  at  the  public  school  level?    Well,  in  my  personal 
experience  and  knowledge  gleaned  from  researchers,  the  following  items  are 
suggested  with  the  idea  that  such  data  might  lead  to  some  reform.    The  fact 
that  such  data  are  collected  could  lead  people  to  pay  attention  to  them. 

1.    The  NCES  should  help  collect  or  report  data  which  distinguish 
between  students  who  read  with  understanding  and  those  who  mostly  recognize 
or  sound  out  words,  and  which  also  assess  students*  level  of  understanding. 

Several  tests  are  now  available  which  can  provide  the  data  indicated 
above.    Among  these  are  the  Degrees  of  Reading  Power  (DRF)  developed  by  the 
College  Board  in  order  to  overcome  some  of  the  obvious  deficiencies  of  the 
Scholastic  Aptitude  Test  and  other  similar  tests.    Another  is  the  Word  Test 
now  being  validated  by  Dr.  Ron  Carver  of  the  University  of  Missouri-Kansas 
City.    The  DRP  and/or  the  Word  Test  and  similar  tests  are  urgently  needed  to 
help  ensure  that  Instruction  is  not  driven  unproductively  toward  mastery  of 
narrow  word  attack  skills  which  do  not  add  up  to  reading  with  understanding. 
This  is  particularly  important  for  disadvantaged  students,  whose  elementary 
and  middle-grades  reading  scores  probably  Improved  in  the  1970*8,  but  who 
did  not  make  adequate  gains  in  reading  with  comprehension.    Comparable  tests 
are  needed  to  provide  improved  assessment  of  problem-solving  in  math  as  well 
as  other  higher  order  skills. 

A  related  test  which  also  should  be  used  to  track  the  educational 
system's  progress  in  developing  the  most  important  skills — i.e.  higher-order 
thinking  skills—is  the  Lawson  Formal  Operations  Test.    This  test  can  help 
not  Just  in  assessing  gains  in  students*  performance  on  higher-order  skills, 
but  indirectly  can  help  determine  whether  science,  social  studies,  and  other 
subject  areas  are  being  taught  to  develop  thinking  skills  rather  than 
unproductive  rote  memorization. 

As  part  of  the  analysis  of  students*  performance  regarding 
comprehension  and  thinking  skills,  the  NCES  should  conduct  an  analysis  in 
selected  big  cities  of  discrepancies  in  performance  between  scores  on  the 
tests  indicated  above,  performance  on  standardized  tests  such  as  the  ITBS, 
the  Stanford  Test,  or  the  Metropolitan,  and  performance  on  state  and  local 
criterion-referenced  tests.    Although  the  conclusions  of  this  analysis  are 
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predictable*  I.e.,  many  standardized  tests  and  mastery  tests  currently  in 
use  frequently  yield  relatively  high  scores  (particularly  in  the  primary 
grades)  when  comprehension  and  other  higher-order  skills  are  low,  and  vice 
versa,  documentation,  verification,  and  publicity  are  urgently  needed  to 
avoid  another  decade  of  disaster  in  working  to  improve  performance  in  big 
cities* 

2.  Higher  order  thinking  skills  beginning  at  4th  grade  and  going  at 
least  through  Bachelors  (particularly  analyzing,  synthesizing  and 
evaluation)  should  become  a  common  measure  in  our  assessment  programs. 

Explanation:    It  is  important  to  know  at  what  age  students  begin  to 
show  real  growth  in  this  type  of  intellectual  development.  Additionally, 
the  purpose  of  education  ought  to  be  in  the  final  analysis  to  develop  this 
type  of  intellectual  development.    There  are  tests  available  to  do  this, 
including  the  DRP. 

3.  Correlation  between  grades,  achievement  tests,  and  social  class. 

Explanatif^-^:    It  is  clear  that  previous  examination  of  how  closely  the 
grading  system  and  testing  program  reflect  social  class  has  been  inadequate. 
It  is  important  to  identify  and  examine  these  patterns.    Also,  it  is 
important  to  identify  if  and  when,  or  where,  this  relationship  begins  to 
change.    These  data  are  already  available  in  schools;  they  need  to  be 
collected  properly. 

4.  Studies  of  cohort  groups  nationally  by  social  class  in  regard  to 
attendance  and  achievement. 

Explanation:    Studies  that  show  a  relationship  between  attendance  and 
achievement  in  schools  could  establish  either  a  direct  relationship  or  lack 
of  a  rolationship,  or  determine  that  in  some  cases  it  matters  and  others  it 
does  not,  i.e.,  are  underclass  children  hurt  by  absence  and  upper  middle 
class  children  not?    Again,  these  data  are  available  now  but  not  correlated 
or  collected  In  this  manner..  They  could  be. 

5.  Alienation  from  school  for  students  beginning  at  grade  5  or  6  and 
through  high  school. 

Explanation:    Beginning  as  early  as  possible,  data  regarding  alienation 
from  school  on  the  part  of  individual  children  or  social  class  cohort  ought 
to  be  collected.    Such  data  when  correlated  with  other  data  might  reveal 
Important  information  concerning  context,  climate,  and  learning. 
Instruments  measuring  this  are  available.    There  was  a  good  deal  of  work  on 
thl&  in  the  70*8,  both  in  the  United  States  and  Canada.    Toronto  University 
was  particularly  known  for  this. 

6.  The  type  and  nature  of  communication  that  occurs  between  the  school 
and  the  community. 

Explanation:    Data  collected  concerning  the  frequency,  content,  and 
type  of  communication  between  schools  and  homes  of  different  social  class 
and  configuration  (single  parent,  stepparents,  foster  houses,  etc.),  might 
begin  to  identify  differences  related  to  expectations.    These  data  are 
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difficult  to  collect  and  would  require  more  time  than  some  might  want  to 
spend  In  the  collection  process. 

?•    Information  concerning  achievement  data  by  social  class  cohort 
relating  to  Improvement  from  year  to  year. 

Explanation:    It  might  be  helpful  to  have  a  better  understanding  of  how 
much  improvement  takes  place  from  year  to  year  by  social  class.    Does  It 
change  as  higher  grade  levels  are  Involved?    How  many  students  overcome 
social  class  disadvantage  at  differing  grades?    Is  the  Improvement  the  same 
and  social  classes  simply  start  at  different  levels?    These  data  are 
available  if  appropriate  collection  procedures  are  used. 

8.  Holistic  d^ta  regarding  students  writing  improvement  on  a  yearly 
basis. 

Explanation:    Qualitative  data  is  difficult  to  collect  nationally. 
Hovever,  performance  data  beginning  In  kindergarten  concerning  language 
development  is  crucial.    Written  essays  could  be  collected  in  Septemtar  and 
another  set  in  May.    (A  national  sample  would  be  needed.)    Teams  to  do 
holistic  grading  of  the  two  essays  would  be  able  to  identify  improvement. 
These  performance  data  would  be  hig^hly  reliable  data  for  prediction  of 
school  success*    They  could  be  collected  in  the  100  largest  school  districts 
in  the  country. 

9.  Other  data  of  importance  not  currently  collected  systematically 


A.  Statistical  data  regarding  Teacher  Absence  and  Student 
Suspensions  with  related  reasons. 

B.  State  and  large  district  comparative  statistical  data  which 
would  be  of  value  and  interest  include:    Technology /Computer 
utilization  and  application;  Extent  and  success  of  the  high  school 
reform  movement;  Success  of  the  Effective  Schools  movement;  Extent  and 
success  of  teacher  competency  testing;  Equity  and  high  risk  children 
(Desegregation 9  Teenage  Pregnancy,  School  Dropouts,  Bilingual  students, 
achieving  excellence  with  equity) . 

In  regards  to  the  equity  and  high  risk  children  icoue,  the  large 
school  districts  are  concerned  primarily  with  learning  about  what 
programs  are  being  developed  and  implemented  to  help  solve  the  problem. 

C.  The  Digest  of  Education  Statistics  provides  most  all 
comparative  data  by  states.    There  Is  one  section  where  selected 
statistics  for  the  120  largest  school  districts  are  provided.  The 
expansion  of  this  particular  section  to  Include  more  teacher  and 
student  data  would  be  useful. 

Again,  the  issue  is  not  how  much  and  how  frequently  to  collect  data. 
It  Is  whether  we  want  to  collect  diagnostic  data  which  will  assist  us  in 
formulating  policies  which  will  do  more  than  measure,  that  is  give 
appropriate  direction  to  initiate  necessary  changes  required  to  improve 
performance  on  the  part  of  educational  institutions  and  students.  The 
populations  in  our  big  cities  do  not  require  more  and  better  assessment  on 
the  wrong  issues;  let  us  all  direct  our  efforts  toward  collecting  data  In  a 
manner  to  give  guidance  in  an  effort  to  Improve  performance. 


are: 


Elementary  and  Secondary  ^-Jj-^ J^.^^iU^sJic;"" 
for  the  National  Center  for  Education  Statistics 


W.   Vance  Grant 
Chief,   Statistical  Information  Office 
National  Center  for  Education  Statistics 


My  goal  in  preparing  thie  paper  ie  to  speak  for  the  users  of  education 
statistics,   those  individuals  and  organizations  that  call,  write,  and 
visit  the  National  Center  for  Education  Statistics  (NCES)   in  their  search 
for  meaningful  data  on  elementary  and  secondary  education  in  the  United 
States.     I  know  the  kinds  of  questions  they  ask,   and  I  think  I  know  the 
kinds  of  statistical  information  that  will  be  most  useful  to  them. 

My  qualifications  for  speaking  for  the  users  are  as  follows:  I 
arrived  at  the  Center  (it  was  known  as  the  Research  and  Statistical 
Services  Branch  of  the  Office  of  Education  in  those  days)   in  December 
1955.     For  some  months  I  worked  on  the  surveys  of  City  School  Systems  and 
State  School  Systems.     Upon  the  completion  of  these  surveys  in  the  late 
summer  of  1956,  my  work  assignment  was  changed  to  include  the  statistical 
information  function,  and  I  have  been  closely  identified  with  the  Center's 
dissemination  program  for  th^  past  29  years.     During  this  time  I  estimate 
that  I  have  talked  with  approximately  3,000  users  a  year,  or  a  total  of 
about  87,000  users  during  the  29- year  period. 

X  have  developed  a  list  of  key  items  in  the  field  of  elementary  and 
secondary  education  that  should  be  collected  on  a  recurring  basis.  Except 
for  those  items  designated  as  Census  data,  the  items  should  be  collected 
by  the  Center  at  the  Stfttg  level.     The  State  figure*  should  then  be 
aggregated  to  provide  national  totals.     Both  State  and  national  totals 
should  be  published  in  regularly  recurring  publications  of  the  Center. 
Great  care  should  be  exercised  to  see  that  the  figure.^  are  comparable  from 
State  to  State  and  consistent  from  one  year  to  the  next.  Consistent 
series  of  data  enable  us  to  measure  trends  over  time,  and  this  is  of  vital 
importance  in  our  work.     The  list  of  key  items  follows. 
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List  of  Basic  Statistics  Frequently  Requested  frim 
tne  Statist icai   Information  Office 
(The  date  of  the  latest   published  and/or  readily  available 
NCES  statistics  follows  each  item) 


Eyblic_Ele[nentary_and_Secondar^ 
Pupi Is 

Enrollment  by  grade*  (Fall  19B3) 

Enrollment  by  level    (elementary  vs.   secondary)*   (Fall  1978) 
Enrollment  by  age,   race,   and  sex   (Census  data) 
Enrollments  in  high  school  subjects*  (19B1-82) 

Average  daily  attendance  and  average  daily  membership*  (1980-81) 
Average  length  of  school  year  and  days  attended  per  pupil  enrolled 
(1980-81) 

Pupils  transported  at  public  expense  (1980-81) 
Employees 

Classroom  teachers  by  level*  (1980-81) 
Classroom  teachers  by  sex*  (1980-81) 
Classroom  teachers  by  teaching  field  (1979-80) 

Other  prufessional  staff  by  type  of  position  and  by  sex*  (by  type  of 

position  only.   Fall  1981) 
Nonprofessional  staff  (Fall  1981) 

Schools 

By  level*  (1982-83) 

By  grade  span  (1982-83) 

School  districts 

By  size  of  enrollment*   (Fall  1981) 
Operating  vs.   nonoperating   (Fall  1982) 

High  school  graduates 
By  sex*  (1980-81) 

By  type  of  program  (Spring  1980  senior  class) 

Revenue  receipts 

From  Federal  Sovernment*  (1982-83) 
From  State  governments*  (1982-83) 

From  local  governments*  (1982-83,   including  other  sources) 
From  other  sources  (gifts  and  tuition  and  transportation  fees) 
(1967-68) 
Nonrevenue  receipts  (1980-81) 

Expenditures 

Current  expenditures  for  regular  school  program*  (1982-82) 
I nst  r uct  ion*   ( 1 980-81 ) 

Salaries  of  classroom  teachers*  (1981-82  estimates) 
Salaries  of  other  instructional  staff*  (1975-76  data  for 

total  instruct  ional  staff) 
Salaries  of  nonprofessional  staff  (1975-76) 
Free  textbooks  (1975-76) 
School  library  books  (1975-76) 
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SuDDiies  and  other  instructional  expenses  (1975-76) 
Adrninisrrar  ion*  ( 1980-81 ) 

Operation  and  maintenance  of  plant*  (1980-81) 

Fixed  rharges*  (1980-81) 

Other  school  services*  (1980-81) 

Vi^ansportat ion  of  public  school  pupils  (1980-81) 
health  and  attendance  services  (1980-81) 
Food  and  other  services  (1980-81) 
Other  current  expenditures  (summer  schools,   community  services)* 

(1980-81) 
Capital  outlay*  (1980-81) 
Interest  on  school  debt*  (1980-81) 

E£ivai^l_e2.ementary_an^_secondar^^ 
Pupi Is 

Enrollment  by  grade   (Fall  1978) 
Enrollment  by  level*  (1970-71) 

Enrollment  by  age,   race,   and  sex   (Census  data) 
Employees 

Classroom  teachers  by  level*  (1970-71) 

Other  professional  staff   (Requested  in  Fall   1978;  not  readily 
avai lable) 

Nonprofessional  staff  (Requested  in  Fall   1978;  not  readily  available) 


Schools  by  level*  (1980-81) 

High  school  graduates  by  sex*  (1964-65) 


*While  all  the  items  on  this  list  are  judged  to  be  important,   those  markea 
with  an  asterisk  are  considered  critical   items  if  we  are  to  continue  to 
provide* adequate  service  to  the  public. 
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Pil  of  tne  aoove  statistics  should  be  collected  at  least  'biennially, 
anc  some  of  the  really  basic  items,    including  public  school  enrollment, 
artenaance,   teachers,   graduates,   revenues,   and  expenditures,   should  be 
collected  on  an  annual  basis.     The  annual  figures  should  be  published  in 
the  kind  of  report  we  used  to  call  Fal l_St atistics_of _PubH c^Eleme 
SDd_Secgndarif_Da^_Schggl.s.      In  preparing  this  report,   we  snould  emphasize 
speed  rather  than  precision,   so  that  the  data  can  be  published  before  the 
end  of  the  school  year  to  which  they  relate.     This  means  that  the 
financial  data  in  the  fall  report  will  necessarily  be  estimates  rather 
than  final,   audited  figures.     When  the  fall  survey  is  repeated,  the 
respondents  should  be  encouraged  to  report  any  changes  that  have  occurred 
in  the  data  they  submitted  for  the  previous  year,   and  those  corrections 
should  be  printed  in  at   least  one  subsequent  edition  of  the  publication. 
Rs  our  model  for  this  kind  of  reporting,   we  might  very  well   look  to  the 
isti!03igS«2f-.§chool_Stat istics,    published  annually  by  the  National 
Education  Association. 

In  addition  to  the  annual  Faii^Statistigs  report,   the  Center  should 
also  publish  a  definitive,   comprehensive  report  on  public  elementary  and 
secondary  education.     This  report,   which  should  be  prepared  biennially, 
will  provide  a  detailed  statistical  account  of  public  education  in  each 
State  and  in  the  Nation  as  a  whole.     It  will  contain  all  of  the  items  on 
public  schools  listed  above,   and  it  may  very  well  include  additional 
information  as  well.     It  will  provide  an  analysis  of  trends  over  time  and 
will  also  devote  considerable  attention  to  interrelationships  among  the 
data  items;  e.g.,   enrollment  will  be  compared  with  the  number  of  teachers, 
and  expenditures  will  be  related  to  the  number  of  pupils  in  average  daily 
attendance!     Our  model  for  this  report  should  be  our  own  St atist ics^gf 
State_Schsgl._Syste(J!S,   which  cne  Center  published  for  many  years  but 
discontTnued"^after  1975-76.     ft  senior  educational  statistician  with  a 
thorough  background  in  public  school  finance  should  be  assigned  the 
responsibility  for  this  major  study. 

I  consider  the  Eaii_§tatist ics  and  §tate.Scbggl_Syst ems  to  be  the 
cornerstones  of  our  elementary  and  secondary  statistics  program,   and  they 
deserve  the  highest  priority  when  we  are  planning  and  conducting  our 
surveys.     I  now  turn  to  surveys  of  secondary  or  tertiary  importance. 

fit  intervals  of  two  or  three  years,   we  should  publish  a  directory  of 
local  public  school  systems.     The  directory,   in  addition  to  giving  names 
and  addresses,   should  provide  a  small  amount  of  statistical  information 
about  each  system.     The  following  items  should  be  adequate:  enrollment, 
teachers,  high  school  graduates,   schools,  and  current  expenditure  per 
pupil.     I  believe  that  a  directory  could  be  designed  that  would  provide 
all  of  this  information  in  a  publication  about  the  same  size  as  the  one  we 
published  in  the  fall  of  1980.     The  1980  publication  contained  much  less 
information,   however.     The  directory  should  also  contain  a  number  of 
analytical  tables  that  show  the  number  of  systems  by  State,   by  grade  span, 
and  by  size  of  enrollment. 
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Every  other  year,   for  those  years  when  we  do  not  preoare  a 
comorenensive  St ate_School_S^sterns  repot^t,   we  snould  publisn  an 
abbreviated  reoort  on  Revenues^snd^ExBerid i,ture 

Slcond^ry_Education.     Trends  in  public  school  finance  are  imoortant,  are 
in  a^state"of"^f  1uk7  and  should  be  measured  annually.     The  publication 
should  provide  State  and  national  totals  on  revenues  by  source  and  on 
exoenditures  by  purpose  but  not  necessarily  in  as  much  detail  as  the  data 
in  State_School._System§. 

We  should  conduct  a  survey  of  priv3ite  elementary  and  secondary  schools 
biennially.     Private  schools  have  increased  in  number  and  in  enrollment, 
and  they  certainly  deserve  to  be  represented  in  our  statistical  program. 
The  great  need  here  is  for  a  consistent  series  of  State  and  national 
figures  on  schools,   enrollment,   teachers,   and  high  school  graduates.  The 
data  should  be  collected  by  affiliation  of  school,   and  the  data  on 
schools,  enrollment,  and  teachers  should  be  by  level;   i.e.,  there  should 
be  separate  figures  for  elementary  and  for  secondary  schools.  Nursery 
school  children  probably  should  not  be  counted  in  our  data  on  elementary 
school  enrollment.     Most  of  these  children  are  probawly  not  involved  in  a 
truly  "educational"  program,  and  their  inclusion  in  our  statistics  makes 
comparisons  between  public  and  private  school  enrollment  almost 
meaningless.     It  was  much  more  meaningful  when  we  could  compare  public  anc 
private  enrollment  by  grade  groups  (kindergarten  through  grade  8  and 
grades  9  through  12)  or  by  level   (elementary,  excluding  prekindergarten, 
'  and  secondary). 

One  of  our  major  studies  that  has  been  conducted  rather  infrequently 
is  the  survey  of  offerings  and  enrollments  in  high  school  subjects.     Whili  ) 
there  are  substantial  difficulties  inherent  in  a  survey  of  this  kind,  the 
fact  remains  that  these  data  are  of  great  interest  and  value  to  the  users 
V  of  education  statistics.     It  was  certainly  a  breakthrough  when  we  were 
able  to  obtain  1981-82  data  from  the  survey  of  High  School  and  Beyond,  and 
I  recommend  that  we  request  similar  data  from  our  respondents  when  we 
conduct  longitudinal  surveys  in  the  future.     Our  eventual  goal  should  be 
to  obtain  these  data  at  intervals  of  about  four  to  six  years. 

The  survey  of  prepr imary  enrollment  should  be  continued  at  intervals 
of  two  or  three  years.  .  There  is  a  good  deal  of  interest  in  early 
childhood  education,  and  this  may  intensify  as  the  number  of  young 
children  increases.     This  would  appear  to  be  the  appropriate  vehicle  for 
measuring  the  participation  of  3-,  4-,   and  S-year-olds  in  nursery  school 
programs.     As  indicated  above,   a  problem  arises  when  you  include  large 
numbers  of  these  children  in  private  elementary  school  enrollment  along 
with  small  numbers  of  them  in  public  elementary  school  enrollment  and  then 
compare  total  enrollment  in  public  and  in  private  schools. 

Special  education  for  the  handicapped  and  for  the  gifted  has  been  the 
focus  of  a  number  of  studies  of  this  office  through  the  years.     After  a 
long  period  of  inactivity  in  this  area,  we  published  a  contract  report, 
Ibg-§SbSSirQaS-H§DdiSSBBgdi   earlier  this  year.     The  report  used  program 
data  from"the  Office  of  Special  Education  and  Rehabilitative  Services, 
U.S.   Department  of  Education,   to  provide  national  totals  on  the  "number  of 
children  3  to  21  served  annually  in  educational  programs  for  the 
handicapped."     I  would  like  to  see  the  Center  do  a  survey,   possibly  a 
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large  s-Htmole  survey,    in  wnich  we  ootain  State  and  national  t-itals  on  the 
nurnbe^"*  of  hanaicaooed  cniloren  and  gifted  cnildren  enrolled   in  snecial 
education  programs.     The  handicapoed  children  should  be  reported  by  type 
of  hanaicao,   and  it  would  be  interesting  to  know  how  many  are  being 
educated   in  regular  public  scnools  and  how  many  in  special  schools  for  the 
handicapped. 

P  pt^omising  area  for  research  is  the  organizational  structure  of 
public  eind  private  elementary  and  secondary  schools.     In  the  recent  past 
we  have  seen  the  rise  of  the  public  middle  school,   a  category  consisting 
of  schools  with  grades  6  through  8,   5  through  8,   or  some  similar 
combination  of  grades.     Pt  the  same  time  there  has  been  some  reduction  in 
the  number  of  public  junior  high  schools,    i.e.,   schools  wilh  grades  7  and 
8  or  7  through  9.     P  study  of  these  trends,   the  number  of  children 
affected,   and  the  influence  of  different  organizational  patterns  on  the 
learning  process  would  be  of  considerable  interest. 

Data  from  this  office  on  the  educational  background,  teaching 
assignment,   years  of  teaching  experience,   and  personal  characteristics  of 
Dublic  school  teachers  would  be  very  useful.     This  kind  of  information  is 
reported  at  five-year  intervals  by  the  National  Education  Pssociation  in 
their  St  at  us_of  _t  fie^Pmerican^Pub^  Our  survey,  based 

upon  data  from  a  nationwide  sample  of  public  school  teachers,   should  not 
be  designed  to  supplant  the  NEP  study,   but   it  should  provide  more  frequent 
data  from  a  substantially  larger  sample. 

Plmost  everyone  is  interested  in  the  dropout  problem,   but  no  one  seems 
to  produce  definitive  data  on  the  number  and  characteristics  of  dropouts 
(  and  why  they  leave  school  before  high  school  graduation.     The  logical 

place  for  a  survey  of  this  kind  is  the  Longitudinal  Studies  Branch  of  the 
Center.     This  group  has  already  followed  up  the  high  school  sophomores  of 
1980  to- see  how  many  of  them  graduated  in  19aa,     This  survey  should  be 
regarded  as  a  trial  run,    because  it  excluded  those  persona  who  dropped  out 
of  school  before  the  spring  of  their  sophomore  year.     vJhen  work  begins  on 
the  next  cohort  of  students,    X  recommend  that  the  study  measure  dropouts 
from  the  beginning  of  the  ninth  grade.     Currently,   about  99  percent  of  the 
young  people  enter  the  ninth  grade,   but  then  the  rate  of  withdrawal  from 
school  accelerates  sharply,   especially  between  grades  10  and  11  and  grades 
11  and  i£.     Most  of  the  high  school  seniors  do  stay  in  school  until 
graduation. 

Pnother  area  that  we  talk  about  a  great  deal  and  where  we  have  very 
little  hard  data  is  the  quality  of  education.     People  want  to  be  able  to 
compare  the  education  provided  in  their  school  system  or  their  State  with 
the  education  in  other  school  systems  or  other  States  or  with  national 
norms.     These  comparisons  are  very  difficult  to  make  unless  one  is  willing 
to  settle  for  quantitative  surrogates  for  quality,   such  as  expenditure  per 
pupil,   average  salary  of  classroom  teachers,   and  pupil-teacher  ratios. 
One  solution  to  this  problem  is  to  use  the  national  norms  provided  by  the 
National  Psse«-3ment  of  Educational  Progress  <NPEP)  and  to  encourage  the 
States  and  even  some  local  school  systems  to  administer  the  NPEP  tests  to 
their  students.     If  enough  States  and  communities  participated  in  the 
program,   we  might  eventually  reach  the  point  where  we  could  begin  to  have 
some  notion  of  the  differences  in  the  quality  of  education  being  provided 
in  different  areas.     Obviously,   the  measures  derived  in  this  way  would  not 
be  the  final  word,   but  they  would  be  a  beginning. 
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I  aon' t  want  to  leave  the  field  of  elemenra.^y  and  secondary  ec'jcarion 
witnout  saying  a  good  word  for  our  sta^cistical  projections  program.  Tnis 
program  is  a  legacy  from  our  good  friend  and   long-time  branch  chief,  Dr. 
Kenneth  ft.  Simon.     The  projections  have  appeared  on  a  regularly  recurring 
basis  since  1964,    and  ou**  statistical   information  staff  uses  them 
constantly.     Especially  iri  the  past  few  years,   when  the  flow  of  reliable 
information  on  elementary  and  secondary  schools  has  slowed  to  a  trickle, 
we  have  found  the  projections  to  be  invaluable.     We  definitely  should 
continue  to  proauce  annual  projections  at   least   10  years  into  the  future 
of  school  enrollment,   teachers,   teacher  supply  and  demand,   high  school 
graduates,   and  expenditures  for  education  at  the  national   level.      I  should 
also  like  to  see  the  program  expanded  to  include  State  projections  of 
enrollment,   teachers,   and  graduates  for  the  school  year  just  beginning  and 
for  5  and  10  years  ahead. 

Up  to  this  point   I  have  talked  mainly  about  the  content  of  our 
elementary  and  sacondary  program.     This  is  appropriate  because  my  work 
makes  me  data  oriented  rather  than  process  oriented.     But,    in  conclusion, 
I  should  like  to  say  a  little  bit  aoout  methodology  and  sources  of  aata. 

In  the  mid-1970' s  there  was  a  great  deal  of  talk  in  the  Center  about  a 
new  survey,   the  Common  Core  of  Data.     This  survey  was  designed  to  provide 
vast  amounts  of  information  ft*om  the  local  school  systems  around  the 
country.     ftoout  this  time  I  had  a  foreign  visitor,    from  India  as  I  recall, 
to  whom  I  was  describing  the  Center  and  its  data  collection  program, 
ftfter  I  had  done  my  best  to  describe  the  Common  Core  of  Cta,   he  responded 
with  indisputable  logic:     "Why  in  the  world  would  anybody  go  to  16,000 
sources  to  get  the  same  information  he  could  get  from  51  sources?"  I 
thought  he  was  right   10  years  ago,   and  I  still  think  so  today.     Nobody  has 
ever  been  able  to  explain  satisfactorily  to  me  why  we  collect  such  a  great 
mass  of  data  on  local  school  systems  that  are  never  published  and  that 
practically  nobody  ever  sees.     Instead  we  should  be  concentrating  our 
limited  resources  on  getting  good  trend  data  from  each  State  department  of 
education  and  on  analyzing  and  publishing  these  State  figures 
expeditiously.     The  data  we  publish  on  local  school  systems  should  be 
limited  to  the  information  in  our  directory  of  school  systems  plus  a 
couple  of  tables  in  the  Dige§t_of_Educst ion.Stat ist ics  and/or  The 
y2Dditi2D-2f^idu£at ion.     find  wa  certainly  should  not  be  collecting  large 
amounts  of  information  that  we  don't  plan  wO  use. 

Our  major  source  of  statistics  on  elementary  and  secondary  schools 
shoulci  be  the  State  departments  of  education.     For  information  that  is  not 
available  in  the  State  departments  and  that  we  still  feel  we  urgently 
need,   we  usually  should  resort  to  sample  surveys.     Useful  information  can 
be  obtained,'  for  example,   from  tlio  population  surveys  of  the  Bureau  of  the 
Census  or  from  a  nationwide  sample  of  teachers.     The  survey  of  private 
elementary  and  secondary  schools  may  very  well  be  an  exception.      If  we  are 
going  to  do  this  survey  at  all,    it  should  be  done  well.     Tw  data  should 
be  consistent  from  one  year  to  the  next  and  should  be  comparable  with  the 
figures  we  obtain  for  public  schools.      In  addition,   we  need  to  be  able  to 
provide  the  private  school  data  by  State,    by  level,   and  by  type  of 
affiliation.     In  order  to  meet  all  of  these  criteria,   a  survey  of  the 
universo  is  probably  required,   even  if  it  means  that  we  have  to  conduct 
the  survey  less  frequently. 
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If  you  have  read  between  the  lines  of  this  paper,    you  naVe  arcnably 
gorten  my  message.      In  case  you  haven' "C,   tne  message  is  tnis:     I  found  a 
nome  here,   and  I  believe  in  the  Center  and  its  mission.     On  the  otner 
nana,   even  a  good  tning  can  be  improved,   and  that   includes  the  elementary 
and  secondary  statistics  program  of  NCES,     One  of  our  uiajor  problems  is 
not  that  we  have  done  too  little,    but  tnat  we  have  tried,    with  limited 
resources,   to  do  too  much.     We  have  spread  ourselves  so  thin  that  the 
really  important  surveys,    like  St  at^st  i,cs_of  _St  ate_Schooi_System     and  Pali 
Statist  i cs_of  _Pu taiic_Eiefnent ar y  .and_Secoridary _Day_Schoois  have  fa  1 1  en 
tnrouch  the  cracksJ      It   is  time  lo  Dick  ud  the  pieces  and  put  them  back 
together  again* 
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This  paper  suggests  two  areas  for  consideration  as  the  federal  data 
collection  effort  Is  redesigned.    It  Is  not  Intended  to  assess  the 
overall  federal  effort »  but  rather  to  Identify  two  specific  policy 
questions  which  currently  available  data  do  not  handle  fully  or 
appropriately.    The  first  question  Is  concerned  with  measures  of  proce  s: 
How  many  and  what  type  of  personnel  are  employed  by  school  districts  and 
what  do  these  personnel  do?    The  second  question  Is  concerned  with  Input 
measures.  It  Is  an  old  question:  What  are»  and  how  do>  various  student 
Input  characteristics  affect  output*  particularly  student  achievement? 
Output  measures*  per  se>  are  not  dlcussed. 

1.    LEVELS  OF  FUNCTIONAL  EFFORT 

The  generax  concern  In  the  first  question  Is  with  measures  of 
functional  effort  in  school  districts.    How  many  and  what  type  of 
personnel  are  employed  by  school  districts  and  what  do  theae  personnel 
do?    The  question  is  basic  and  deceptively  simple;  but  getting  accurate 
measures  is  difficult. 

Of  most  concern  here  is  the  level  of  effort  devoted  to  the 
administration  of  schools  and  school  districts.    There  are  two  malt^  parts 
of  this  discussion.    The  first  part  focuses  on  the  Importance  of  getting 
reasonably  good  measures  of  administrative  effort;  and  the  second  part 
discusses  how  this. might  be  done. 

Indicators  of  administrative  effort  are  useful  measures  in  any  type 
of  organization.    There  is  a  natural  tendency  for  the  administrative  part 
of  an  organization  to  grow  and*  because  the  marginal  contribution  of 
administration  to  productivity  is  difficult  to  ascertain*  internal  checks 
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on  growth  are  limited.  In  educational  organizations,  it  is  particularly 
important  to  get  good  measures  of  administrative  effort.    In  addition  to 
general  problems  of  assessing  the  marginal  contribution  of  administrative 
activity  to  the  organization's  welfare,  there  is  the  more  specific 
problem  in  education  of  a  production  process  that,  itself,  is  not  well 
understood.    This  compounds  the  problem  of  factoring  out  the  extent  to 
which  administrative  efforts,  over  and  above  other  factors,  contribute  to 
productivity. 

Although  the  technology  of  educational  institutions  is  not  well 
understood,  these  institutions  still  must  be  responsive  to  community 
needs.    Educational  institutions  are  important  to  society.    In  them 
reside  the  hopes  of  society  for  its  future  as  well  as  the  repository  of 
the  best  of  its  past.    Society  has  placed  great  trust  in  them  and,  not 
surprisingly,  looks  for  verification  of  this  trust.    In  general, 
educational  institutions  respond  in  symbolic  ways  rather  than  through 
actually  modifying  some  central  aspect  of  their  process  or  their  product. 
(Meyer  and  Rowan,  1977.)    It  is  therefore  possible  for  educational 
institutions  to  be  very  sensitive  to  consumer /community  pressures,  but  to 
do  so  in  ways  that  have  very  little  effect  on  the  actual  productivity  of 
the  system.    For  example,  simply  assigning  an  individual  to  serve  as  a 
Director  of  Evaluation,  or  Community  Relations,  or  Bilingual  Education  or 
Programs  for  the  Gifted,  can  go  a  long  way  in  satisfying  demands  for 
responsiveness  to  community  concerns.    Administrative  responses  are 
immediate  and  visible.    Changing  the  "production  process"  is  not  only 
more  difficult,  but  the  effects  of  any  changes  on  the  system's  output  are 
uncertain  and  long  term.    To  some  extant  this  is  functional  for  the 
organization.    The  central  production  tasks,  i.e.,  the  teaching  and  j 
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learning  concerns i  are  buffered  from  the  whims  of  the  environment.  But 
it  also  suggests  that  the  contribution  of  administration  to  productivity 
may  be  less  than  what  is  commonly  assumed. 

A  close  watch  should  probably  be  kept  on  levels  of  administrative 
effort  during  times  of  leform  and  during  periods  of  enrcllment  decline. 
The  typical  way  in  which  almost  all  organizations  respond  to  productivity 
problems  is  to  improve  management.  In  general,  this  makes  sense.    One  of 
the  important  functions  of  management  is  to  design  production  processes 
so  that  at  least  a  minimum  quality  of  work  is  performed.    If  the  quality 
is  lower  than  what  it  should  be»  it  is  management's  job  to  do  something 
about  it.      But  if  the  link  between  administrative  activity  ana 
production  activity  is  not  clear  (Hannaway  and  Sproull,  1978) »  i.a.,  if 
it  is  unclear  what  administration  should  do,  or  is  doing,  to  improve 
education,  problems  can  emerge.    Better  management  can  simply  become 
equated  with  more  management,  i.e.,  more  supervisors,  more  rules,  more 
requirements.  Their  immediate  effect  on  satisfying  external  pressure  for 
the  system  "to  do  something"  may  be  great,  but  their  longer  term  effect 
on  educational  productivity,  j.e.,  student  learning,  may  not  be  very 
powerful. 

Unlike  periods  of  enrollment  grov^h,  where  increases  in  the  size  of 
administration  may  not  be  very  costly  for  the  organization  (i.e.,  the 
proportionate  expenditure  on  administration  may  not  change) ,  the  cost  of 
an  increase  in  administrative  size  during  decline  could  be  quite  high. 
Administration  would  increase  relative  to  the  other  parts  of  the 
organization  implying  a  reduction  in  real  expenditures  on  direct  service, 
i.e.  student  contact  activities.    Indeed,  findings  h.%ve  suggested  that 
during  periods  of  enrollment  decline  the  relative  size  of  the 


administrative  apparatus  of  school  districts  is  greater  than  it  is  during 
growth  (Hannan  and  Freeman,  1975;  Hannavay»  1977;  Freeman,  Hannan  and 
Hannaway,  1977). 

If  it  were  possible  to  measure  the  productivity  trade-off  between 
direct  services  (l.e.»  teaching)  and  administration,  one  might  be  able  to 
calculate  an  optimal  resource  allocation  scheme.    But  this  is  not 
possible.    It  seems  reasonable  to  speculate,  however,  that  beyond  some 
base  level  of  administrative  support,  the  marginal  productivity  of  a 
teacher  is  greater  than  that  of  an  administrator.    After  all,  a  teacher 
Impacts  directly  on  student  learning. 

The  growth  of  administrative  systems,  it  should  be  stressed,  is  not 
necessarily  due  to  the  self-aggrandizement  of  administiators.    No  doubt 
many  reformers  truly  believe  that  more  administration  leads  to  better 
education.    And,  indeed,  some  administrative  practices  may  have  a 
significant  positive  effect  ou  educational  productivity.  Unfortunately, 
however,  we  6  *  tiOt  have  a  good  handle  on  the  benefits  of  either  different 
types  of  administrative  activity  or  varying  levels  of  administrative 
effort.    Some  information  that  we  do  have  on  administrative  behavior  at 
the  central  office,  however,  suggests  that  admJ.^istrators  prefer  to 
engage  in  activities  that  relate  to  external  agencies  rather  than  in 
activities  that  relate  to  teaching  and  learning  concerns  in  the  system 
(Hannaway,  1985).    This,  of  course,  is  very  troublesome.    It  suggests 
that  externally  generated  reforms  could  have  significant  effects  on  the 
volo^ie  of  administrative  activity  and  little  effect  on  the  conduct  of 
teaching  and  learning  activities.    Our  understanding  of  the  relationship 
between  administrati  on  and  educational  productivity,  or  more  generally 
between  different  levels  of  pe'^sonnel  effort  and  productivity,    can  be 
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improved  by  collecting  and  analyzing  data  that  permit  direct 
investigation  of  these  issues. 

Two  different  types  of  data  are  discussed  belnw.    Each  represents  a 
different  level  of  data  collection  and  each  would  provide  information  to 
similar  questions  but  on  different  levels  of  specificity.    Some  of  these 
questions  are:    What  is  the  variation  in  the  distribution  of  manpower 
effort  across  school  districts  and  what  determines  different  allocations? 
How  do  different  distributions  and  levels  of  effort  contribute  to 
educational  productivity.    Sampling  and  cost  considerations  would  vary 
according  to  the  type  of  data  needed  and  the  specificity  of  the  question. 

a).  Counts  of  Personnel  in  Different  Personnel  Categories. 

This  seems  like  fairly  straightforward  data;  but  personnel  data  can 
be  categorized  very  differently.    One  way»  for  example,  is  to  report  the 
number  of  individuals  in  each  district  with  different  certificated  status 
(e.g.,  the  number  of  individuals  certified  as  teachers,  psychologists, 
administrators,  etc.).    But  this  can  be  very  misleading  for,  at  lease, 
two  reasons.    First,  individuals  do  not  necessarily  carry  out  functions 
defined  by  their  certificated  status.    For  example,  an  individual  with  an 
administrator  credential  could  be  teaching;  or  a  teacher  might  be  working 
on  special  project  for  the  superintendent  rather  than  in  the  classroom. 
Second,  states  use  different  definitions  for  the  same  category.    What  may 
be  defined  as  an  administrator  is  one  state  may  be  defined  as  a 
curriculum  supervisor  in  another.    Cross  state  comparisons,  therefore, 
can  be  very  misleading. 


Personnel  might  be  categorized  In  more  useful  ways.    One  posslbil:ity 
Is  to  categorize  personnel  according  to  how  directly  they  contribute  to 
student  learning.    Those  who  spend  a  majority  (or  some  otl^er  determined 


category;  those  who  contribute  Indirectly*  e.g.*  principals  and 
curriculum  supervisors,  could  be  a  second  category,  and  those  who  provide 
support  for  the  system  but  who  are  not  concerned  with  teaching  and 
learning  activities,  e.g.,  personnel  directors  and  accountants,  might  be 
considered  a  third  category.    It  clearly  would  take  some  thinking  to  work 
out  meaningful  groupings,  but  the  main  point  is  that  some  accounting 
based  on  the  extent  of  direct  contribution  to  student  learning  could  be 
useful  and  it  should  be  done  in  a  consistent  way  across  states. 

Some  current  personnel  categories,  such  as  'other  administrative' 


and  'other  instructional'  are  quite  large  in  some  states  and  quite  small 
in  others  (Digest,  p. 49-50).    For  example,  in  New  York  there  are  nearly  4 
times  as  many  'other  instructional'  personnel  than  there  are  principals 
and  in  Florida  there  are  more  than  3  times;  but,  in  Connecticut  and 
Missouri  there  is  not  one  person  in  this  personnel  category.    Who  are 
these  'other  instructional'  professional  people  and  is  it  reasonable  to 
expect  that  they  make  a  direct  contribution  to  student  achievement?  Is 
it  possible  that  New  York  (and  some  other  states)  provides  some 
additional  and  different  instructional  support  for  students  that 
Connecticut  and  Missouri  do  not?    If  so,  what  is  it  and  is  it  worth  it? 
Or,  do  these  figures,  more  simply,  reflect  the  different  way  states 
certify  and  therefore  categorize  personnel? 

Without  good  measures  of  the  type  suggested  here,  it  is  impossible 
to  analyze  how  different  reforms  or  different  state  administrative 
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systems  affect  the  allocation  ol  personnel  effort  at  the  local  level  or 
to  understand  completely  why  reforms  might  (or  might  not)  affect  student 
achievement. 
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b).    Time  allocation  of  individuals >    The    srsonnel  categories 
discuSw^'d  above  would  give  gross  measures  of  functional  effort  across 
districts  and  states.    Finer  grained  information^  e.g.>  how  much  time 
administrators  spend  on  different  types  of  issues »  could  give  a  better 
picture  of  the  types  of  work  demands  placed  on  educational  professionals 
and  how  they  respond  to  these.  This  type  of  data>  however,  is  both 
difficult  and  expensive  to  collect.      Information  about  districts  under 
(a)  could  be  collected  regularly  in  a  standard  format  across  states;  but 
the  micro  level  data  suggested  here  should  be  collected  from  a  small 
sample  of  individuals/  districts/  states  on  only  an  occasional  basis. 

Examples  of  questions  that  this  type  of  data  can  inform  are:  To  what 
extent  are  principals  focussed  on  teaching/learning  concerns  and  to  what 
extent  on  purely  administrative  chores?    What  are  the  administrative 
costs  of  categorical  aid  programs?    How  much  time  do  principals/ 
counselors/  teachers  spend  working  with  parents?    All  these  questions  are 
concerned  with  how  educational  professionals  themselves  allocate  their 
attention  and  effort.    For  instance,  individuals  serving  as 
administrators  of  a  special  education  program  could  be  spending  varying 
amounts  of  time  talking  to  accountants,  trying  to  keep  track  of  the 
dollar  flow;  or  to  teachers,  working  out  special  classroom  arrangements; 
or  with  parents,  coordinating  school  and  home  support.    One  would  expect 
that  these  activities  contribute  differentially  to  student  learning  and. 


from  a  policy  perspective,  we  would  want  to  structure  the  demands  of  the 
job  in  such  a  way  that  the  greatest  learning  possible  would  take  place. 
Informarion  on  task  demands  and  how  they  are  handled  could  help  do  this. 

There  are  clearly  some  methodological  problems  in  collecting  time 
allocation  data*  (See  Hannaway»  forthcoming.)    But  it  would  probably  be 
worthwhile  trying.    One  way  not  to  get  estimates  of  time  allocation  is  to 
ask  respondents  how  they  spend  their  time.    At  least  in  the  case  of 
administrators,  this  method  is  beset  with  biases.    Managers  are  not  very 
accurate  reporters  of  what  they  do»  probably  because  they  engage  in  many 
varied  tasks  most  of  which  last  only  a  few  minutes.    The  mental  exercise 
they  are  asked  to  perform  in  making  an  estimate  is  complex;  they  must 
first  recall  and  then  aggregate  thousands  upon  thousands  of  short  tasks. 
Their  estimates  are  based  on  recall  and  what  managers  are  likely  to 
remember  are  those  tasks  that  are  particularly  vivid  in  their  memory  and 
those  that  fit  with  preconceived  notions.  Therefore,  they  tend  to 
overestimate  tasks  they  found  particularly  rewarding  (or  painful)  and 
those  tasks  that  conformed  with  their  normative  expectations  of  what 
someone  in  their  position  should  do.    When  aggregating  their  tasks »  they 
tend  to  underestimate  tasks  of  short  duration  even  though  there  may  be 
many  such  tasks  that  together  account  for  a  large  fraction  of  their  time. 

One  way  to  proceed »  which  would  be  both  reasonable  methodologically 
and  not  terribly  costly  would  be  to  use  the  diary  method.    This  method 
has  been  used  successfully  with  both  managers  (Stewart »  1967)  and  college 
presidents  (Cohen  and  harch,  1974).  Either  the  respondent  herself  or  her 
secretary  would  keep  a  log  of  daily  activities.    A  selected  number  of 
Individuals  representing  a  personnel  category*  say,  special  education 
administrators  »  might  keep  track  of  what  they  do  for  one  day.  The 
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results  from  a  reasonable  sample  for  any  particular  day  could  be  quite 
informative.    Timilar  studies  of  the  time  allocation  of  other  types  of 
personnel,  e.g.,  principals,  could  also  be  done.    This  type  of  study 
would  require  more  thought,  organization  and  coordination  than  a  standard 
survey,  but  the  results  might  be  well  worth  the  effort. 

Both  of  the  above  suggestions  for  data  are  based  on  the  simple 
assumption  that  in  order  to  get  a  better  understanding  of  the 
determinants  of  educational  output  we  should  get  a  better  understanding 
of  educational  process.    There  are  researchers  who  are  asking  similar 
questions  at  the  classroom  level  which,  no  doubt,  will  be  fruitful.    I  am 
suggesting  that  information  about  the  direction  and  intensity  ^f 
functional  effort  across  the  district  as  a  whole  could  be  valuable  itself 
as  well  as  a  complement  to  classroom  level  information. 

( 

2.    PUBLIC  AND  PRIVATE  SCHOOL  INPUT 


There  has  been  a  considerable  amount  of  attention  and  debate  given 
to  the  relative  success  of  public  and  private  schools  in  producing 
cognitive  achievement;  i.e.*  the  output  of  the  two  systems.    Much  of  the 
debate  and  controversy  has  centered  on  the  input*    Critics  argue  that 
private  schools  do  better  because  they  are  working  with  different  types 
of  students  and  that  standard  background  measures,  such  as  those  used  by 
Coleman,  Hoffer  and  Rilgore,  do  not  capture  these  differences.    This  is 
an  important  public  policy  debate  and  one  that  current  data  do  not  allow 
us  to  sort  out  completely. 

The  only  way  to  get  accurate  measures  of  the  effect  of  private 


schools  (or  different  types  of  public  schools)  is  to  factor  out  in  a 
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completely  reliable  way  self '^ZDselectlon  effects.  This  can  be  done  with 
some  confidence  statistically;  but  collecting  parent/  student  measures 
prior  to  schooling  choices  would  be  preferable.    The  basic  questions  is: 
Are  private  school  students  (and  parents)  different  from  their  public 
sQhool  counterparts  before  they  even  enter  private  schools?    For  example » 
does  private  school  selection,  by  itself,  indicate  higher  levels  of 
parent  and  student  motivation  and  commitment  to  education;  or  do  private 
schools,  and*  perhaps »  the  very  act  of  choice  by  parents  foster  certain 
attitudes*  values  and  behaviors? 

To  truly  distinguish  self-selection  effects  Irom  school  effects 
requires  a  different  type  of  data  collection  effort  where,  perhaps,  a 
small  number  of  communities  are  selected  and  the  attitudes*  experiences 
and  choice  behavior  of  members  of  those  communities,  i.e.*  parents  and 
students,  are  studied  over  time.    From  this,  it  would  be  possible  to 
estimate  the  extent  to  which  public  and  private  school  parents/students 
are  different  as  well  as  the  experiences  that  contribute  to  parents 
opting  out  of  (or  staying  in)  a  particular  school  or  school  system. 

Such  an  effort  should  not  be  considered  a  substitute  for  data 
already  being  collected  on  private  and  public  school  comparisons*  but 
rather  an  additional  effort  to  address  a  very  specific  and  very  basic 
question  about  the  characteristics  of  public/private  school  input. 

Input  differences  may  also  be  important  for  teachers.  Are 
individuals  with  different  characteristics  and  values  attracted  to  public 
and  private  school  teaching?    How  does  the  culture  of  the  school  affect 
teacher  behavior  and  attitudes.    Answering  these  questions  would  also 
.  best  be  done  using  some  type  of  longitudinal  data  collection  design. 
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While  the  returns  from  such  an  effort  would  probably  not  be  immediate > 
studying  teachers  in  this  way  could  be  quite  profitable. 

It  has  long  beer  recognized  that  professionals  are  affected  by 
normative  expectations  communicated  during  their  training  and  on  the  job, 
especially  their  first  job.      And  it  is  not  unreasonable  to  expect  that 
the  normative  structure  of  a  school  is  affected  by  its  institutional 
arrangements.    Consider*  for  example*  the  different  roles  that  parents 
play  in  different  types  of  schools  and  the  likelihood  that  parents  convey 
expectations  and  rewards  different  from  other  involved  parties,  e.g.* 
state  bureaucrats  or  union  representatives.    If  i  'ormation  were 
collected  from  teachers  over  time*  say,  in  a  community  study*  it  could 
lead  to  a  better  understanding  of  the  determinants  of  teacher  behavior. 
That  is*  it  would  be  possible  to  track  teacher  characteristics/  behaviors 
and  estimate  the  extent  to  which  these  are  affected  by  institutional 
arrangements  and  parent/student  characteristics. 

This  paper  focussed  on  two  weaknesses  in  the  current  data  collection 
effort  ot  the  federal  government.    One  was  concerned  with  r*  proc^.ss 
measure  and  the  other  with  an  input  measure.    These  weaknesses  limit  our 
ability  to  addresr  policy  quesf'ons  about  the  educational  process  and  how 
it  is  affected  by  various  reforms  and  institutional  arrangements.  There 
was  no  discussion  of  output  measures.    The  responsibility  of  the  federal 
government  in  this  regard  is  less  clear.    While  some  overall  assessment 
of  the  state  of  educational  productivity  in  whe  country  is  within  its 
purview*  education  reforms  are  being  formulated  and  administered  at  the 
state  and  local  levels.    And  it  is  information  at  the  school  level  that 
will  be  most  useful  in  evaluating  and  refining  the  reform  effort.  This 
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level  of  information  Is  probably  best  collected  by  states  and  district 
who  will  also  be  the  users » 
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ABSTRACT 


This  paper  examines  concerns  about  the  educational  orocessin 
relationship  tc  policy  issues  and  administrative  needs  and 
measurement  of  our  Nation's  education  systems. 

This  paper  Identifies  soecific  data  elements  that  can  provide 
necessary  information  in  suoport  of  oresent  and  future  government, 
business,  and  academic  decisionmaking,  and  that  can  helo  Inform 
the  American  public. 

Specific  Issues  addressed  in  this  paper  include  the  following: 

•  Opening  statement  of  self-worth  and  its  Importance 
in  the  search  for  excellence 

•  A  discussion  centered  around  the  problem  of  how 
self  esteem  can  be  developed  in  the  classroom 

•  Areas  for  new  data  Ldses  which  Include: 

Desirable  qualities  of  teachers  and  their  impact 
on  student  achievement; 

Which  of  these  qualities  are  essential  for  measurable 
academic  achievement; 

Teacher  qualities  essential  for  the  development  and 
enhancement  of  pupil  self-esteem  and  pupil  creativity; 

Methods  of  evaluation  for  non-traditional  teaching  methods; 

Weighing  out  affective  attributes  of  teachers; 

Improving  "state  of  the  art"  by  correlating  effective  student 
outcomes  with  well-defined  successful  teacher  behaviors  and 
competencies. 

•  Description  of  "Teachers  I  Have  Known" 

•  Teacher  ability  to  define  classroom  objectives  and  to  facilitate 
excitement/motivation  in  the  classroom 
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THE  QUEST  FOR  EXCELLENCE/PUDR  SELF-ESTEEM 


Introduction 

Probably  the  most  important  reason  for  striving 
for  excellence  is  because  it  creates  opportunity, 
— .It  goes  without  saying,  that  it  is  the  students 
who  have  achieved  excellence  who  will  have  the 
best  opportunities  for  challenging  work,  top  pey , 

and  access  to  graduate  school  Another  reason 

to  strive  fo^  excellence  is  because  it  is  basic 

to  your  self  esteem  We  all  have  a  considerable 

investment  in  our  education  and  we  spend  one  third 
of  our  working  lives  on  the  job.    WE  HAVE  A  NEED 
FOR  SELF-WORTH  AND  THAT  COMES  FROM  DOING  A  JOB 
AS  BEST  WE  CAN. 

R.  B.  Powell 


The  above  quote(s),  taken  from  an  address  at  the  annual  conference  of 

the  Mexican-American  Engineering  Society  (MAES)  can  and  do  apply  to 

students  or  teachers  of  any  race,  and  to  all  aqe  qrouos.  Powell 

stresses  the  idea  that  although  we  are  usually  rewarded  for  excellence  ) 

in  schools  or  on  the  job,  there  is  also  a  feeling  of  self-satisfaction 

that  comes  from  doing  a  job  well.    This  sense  of  oride  cannot  be  taken 

away  and  it  cannot  be  diminished  by  the  fact  that  there  may  be  no  snecific 

monetary  reward  attached  to  a  given  assignment.    "Self-esteem",  he  continues, 

"is  important,  and  fortunately,  it  is  a  by-Droduct  in  the  search  for 

excellence". 

For  the  past  six  years,  while  developing  a  science  curriculum  orogram 
which  emphasizes  successful  scientist  role  models  who  have  overcome 
numerous  obstacles,  I  have  been  extremely  imoressed  by  the  healthy 
self-esteem  of  over  one  hundred  of  the  SOUNDS  OF  SCIENCE  role  models. 

Since  these  materials  are  designed  primarily  for  use  in  the  uoper  elementary 
and  middle  school  grades,  great  efforts  have  been  made  to  relate  to 
pre-adolescents  the  lifestyles,  likes  and  dislikes,  hobbies,  favorite 
school  subjects,  personality  traits,  and  other  useful  data  about  these 
scientist  role  models  when  they  were  pre-adolescents.    The  majority  of 
these  role  models  did  not  have  extremely  high  self-esteem  as  youngsters. 
Some  of  their  self-described  traits  as  youngsters  are  loneliness,  self- 
appraisals  of  being  ohysically  unattractive',  exoeriencinq  aversion  to 
certain  academic  subjects,  having  little  knowledge  of  what  they  would 
become  as  c  .Its,  etc.    The  great  majority      these  persons,  however, 
can  still  remember  a  significant  aduU  who  encouraged  them  to  be  the 
best  of  whatever  they  pursued,  and  at  least  fift^'  percent  of  these 
scientists  were  encouraged  to  study  mathematics  and  science  in  high 
s'chool.    Few  respondents  can  ••emember  being  encouraged  by  their  junior 
high  or  high  school  teachers  to  pursue  careers  in  science.    Noting  / 
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the  difficulties  of  Generalizing  and  thus  diminishina  the  results  of 
two  years  of  gathering  data  on  over  350  successful  scientists,  the 
Tollowing  characteristics  are  reported  only  because  they  accurately 
describe  90%  of  the  scientists:    They  loved  oets  and  soent  a  great 
deal  of  time  with  their  individual  oets;    they  had  soecific  tasks 
to  Derform  around  the  house  or  had  after-school  jobs  for  which  they 
received  earnings;    and  most  significantly,  they  belonged  to  several 
extra-curricular  clubs,  sDorts  or^ganizations,  music  organizations, 
(band,  choir,)  and  they  were  always  busy.  How  much  did  these  activities 
contribute  to  their  eventual  success  as  scientists? 

A  final  reason  why  striving  for  excellence  is 
so  important  to  minority  engineers  is  because 
it  serves  as  an  example  to  fellow  students, 
co-workers,  and  to  the  community ,  which  others 
can  follow^    This  is  especially  important  to 
various  Minority  groups  where  there  is  a 
shortage  of  role  models  in  many  fields,  including 
science  and  engineering.    And  by  having  more  role 
models  who  are  striving  for  excellence  in  schdol 
or  on  the  job,  the  young  students  will  also  respond 
and  follow  that  lead  because  they  will  know  that 
striving  for  excellence  is  desirable  and  achievable. 
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The  question  to  be  addressed  in  this  oaoer  is  centered  around  the 
probipm  of  how  self-esteem  can  be  enhanced  in  the  classroom.  The 
aforementioned  scientists  did  not  have  hiqh  self-esteem  as  youngsters, 
^.ccording  to  their  own  individual  assessments.    How  did  they  achieve  the 
high  level  of  success  which  they  now  enjoy  and  at  what  ooint  did  self-esteem 
develop  or  evolve,  and  more  importantly,  what  set  of  conditions  must  be 
present  in  the  classroom  to  facilitate  or  brinn  about  a  student's  sense  of 
great  self-worxh? 

I  have  chosen  to  not  dwell  on  the  all  imoortant  areas  of  cultural  Pluralism, 

SES  of  pupils,  parental  involvement  with  student  learning,  etc.,  because 

the  data  on  these  topics  has  been  more  than  adequately  documented.  Instead 

I  have  chosen  to  limit  this  d:;cussion  to  the  qualities  of  teachers  and  the 

quality  of  the  day-by-day  exoeriences  in  the  classroom.    Thore  have  been 

numerous  oapers  written  and  countless  workshons  and  seminars  and  or  conferences 

devdted  to  the  causes  of  student  failures,  and  all  too  often,  the  blame  has 

been  placed  on  the  lack  of  student  readiness  to  learn,  to  parental  aoathv, 

cultural  and  economic  plights^  etc.    It  seems  to  me  that  only  in  education 

do  we  place  so  much  emohasis  on  what  happened  vesterday,  last  year,  and 

other  historical  events  as  we  absolve  our  own  inability  to  solve  tne 

problem  of  what  we,  the  professional  educators  can  do  to  help  millions 

of  students  to  achieve  academic  success.    Does  the  mechanic  ask  the  owner 

of  the  automobile  how  it  hapoened  that  the  brake  lining  wore  thin?  When 

approached  to  change  a  flat  tire,  does  the  service  station  attendant  ask 

"Where  were  you  when  you  ran  over  this  nail?"    Is  there  one  set  of  Instructions  ) 

for  changing  the  oil  if  the  car  owner  has  just  returned  from  a  5,000  mile 

trip  as  opposed  to  the  negligent  driver  who  drove  the  car  around  town  for 

a  year  and  forgot  to  have  the  oil  changed?   If  a  car  window  is  broken  by  a 

burglar,  is  there  a  different  method  of  installing  a  new  window  than  if  the 

car  were  involved  in  a  collision?   Does  the  dentist  use  a  different  method 

to  remove  a  tooth  if  the  patient  broke  the  tooth  in  a  fight,  as  opoosed 

to  breaking  the  tooth  while  accidently  bitinq  down  on  an  unknown  object? 

Tile  acknowledgment  of  cause  of  breakdown  may  indeed  impact 
on  the  method  of  reoair,  but  the  quality  of  the  finished  oroduct  remains 
unaffected.    The  point  is  that  teachers,  educators,  administrators,. .our 
education  profession  In  its  total ityt  must  cease  and  desist  the  practice  of 
concentrating  on  the  various  caus^5  for  our  oupils'  failure  to  achieve 
and  move  to  affectuate  quality  classroom  experiences  which  will  insure 
student  excitement,  inquisitiveness ,  and  a  genuine  desire  for  knowledge. 
Instead  of  shaking  our  heads  in  disgust  and  occasionally  with  contemot  for 
those  stiidents  who  have  difficulty  making  their  way  throuqh  the  educational 
maze,  we  must  set  into     motion  a  set  of  conditions  which  .ill  result  in 
a  well -ordered,  self-disciplined,  orderly  school  environment  without 
which  learning  cannot  take  place. 

In  many  disciplines,  research  reports  are  based  on  exoerimental  data. 
The  mere  nature  of  education  of  youngsters  dictates  that  our  research 
Vill  be  empirical  in  nature,  and  most  of  educational  theory  is  therefore 
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based  on  this  type  research.    Empirical  data  is  most  useful  when' we  set 
out  to  study  entities  designed  to  imorove  our  own  imoact  on  society,  for 
future  generations: 


•  What  are  those  qualities  of  teachers  which  are  oositivp  and 
desirable  in  an  effective  school? 

•  What  are  those  qualities,  though  positive  and  desirable,  which 
have  little  or  no  impact  on  student  achievement? 

•  How  many  of  these  qualities  or  variables  carry  heavy  weight 
in  the  hiring  process?    In  the  evaluation  rrocess? 

•  Which  teacher  qualitiesCprioritized)  are  essential  for 
measurable  academic  achievement  of  students? 

•  Which  teacher  qualities  are  essential  for  the  development  of 
high  pupil  self-esteem,  for  the  enhancement  of  ouoil  creativity, 
and  can  these  teacher  qu? lities  be  measured  by  traditional  methods? 

•  What  methods  can  be  utilized  to  evaluate  essential  qualities  ' 
which  cannot  be  measured  by  traditional  methods? 

•  How  much  weight  should  be  attached  to  the  following  teacher 
qualities? 

Great  personality 
Warmth,  caring  attitude 
Attractive  physically 

Ability  to  "get  along"  with  other  faculty  and  administration 

•  Are  there  consistent  specifically  identifiable  characteristics  unique 
to  the  students  of  certain  sucessful  teachers  in  a  given  school?  Can 
these  characteristics  be  isolated  and  correlated  with  the  learning 
environment  and  process (es)  from  which  these  students  benefitted? 

Could  such  information  be  beneficial  to  the  "state  of  the  art"? 


TEACHERS  I  HAVE  KNOWN 


J  have  known  some  very  unpopular  teachers;  scorned  by  their  colleagues, 
and  highly  respected  by  their  students. These  teachers  were  known  to  accent 
nothing  but  the  very  best  from  all  of  their  ouoils.    They  had  no  patience 
with  student  mediocrity  and  they  spent  no  time  with  borderline  students, 
They  pushed  the  "real  scholars"  almost  Beyond  their  limits.    They  challenged 
their  bright  students,. .excited  them,. .leaving  the  "dummies"  by  the  wayside. 
IS  there  a  place  for  teachers  such  as  this  in  the  American  educational  system? 

J  have  known  sympathetic  teachers  who  could  get  unbelievable  results  from 
"slow  pupils"  ,'''make  them  feel  terrific,  smart,  useful,  indefatigable  in 
their  aup^t  for  more  knowledge ,  for  the  perfect  score/T^ese  teachers  were 
criticized  often  by  the  "smart  high  IQ  students"  who  became  impatient  with 
the  repetition,  the  praise  (who  needs  it?),  the  comoassion.    is  there  a 
place  for  teachers  such  as  this  in  the  American  educational  system? 
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I've  known  teachers  who  couldn't  get  to  school  in  tiwe  to  "check-in"  by 
8:00  AM  but  who  managed  to  always  be  in  place  by  8:15  for  their  First  Hour 
Class  which  began  at  8:30  AM.    They  usudlly  Stayed  in  their  classrooms 
long  after  the  3:30  PH  "sign-out";  maybe  until  very  late  in  the  evening.  They 
were  "night  people"  who  blossomed  late  in  the  day.    Thev  stayed  until  they 
were  satisfied  with  the  results  which  they  diligently  sought.    Since  time 
was  not  that  important  to  them.. they  considered  it  not  at  all  unusual  to 
work  after  school,  or  on  weekends  with  a  student  who  needed  the  extra  time, 
or  an  instrumental  or  vocal  ensemble  who  needed  extra  rehearsals  to  ensure 
that  the  performance   met  the  highest  standard.    These  teachers  were  moti- 
vated by  one  entity;   excellence!    Further  handicanoed  by  their  inability 
to  get  required  reports  turned  in  on  time,  these  teachers'  inability  or  ^ 
unwillingness  to  submit  timely  reports  olaced  undue  inconvenience  and  aggra- 
vated baggage  on  the  principal  or  on  the  orincioal's  secretary.  These 
unorthodox  teachers  almost  always  caused  the  school  showcase  to  become 
overburdened  by  the  countless  Superior  tronhies  garnered  by  their  students 
in  Debate,  Gymnastics,  Athletics,  Science  Fairs,  Academic  Olympics,  Vocal 
and  Instrumental  Contests,  etc.  But,  their  report  cards  were  never  turned 
in  on  time,  they  were  late  for  faculty  meetings,  and  sometimes  they  even 
had  the  unmitigated  gall  to  MISS  IMPORTANT  FACULTY  MEETINGS!  (Coaches  work 
is  important,  but  the  line  must  be  drawn  somewhere!)    Is  there  a  place 
for  teachers  like  this  in  the  American  educational  system? 

1 

Bloom  contends  that  teachers  are  seldom  hired  for  those  qualities  which  are 
essential  to  effective  pupil  achievement.    I  contend  that  too  little  infor- 
mation has  been  documented  on  the  subject  of  teacher  qualities  which  are 
measurable  and/or  widely  accepted  from  school  system  to  school  system. 

TEACH£R/LEARNER  OBJECTIVES  DEFINED 

The  final  area  of  this  paper  aariresses  a  concern  which  I  feel  is  perhaps 
discussed  in  Teacher  Education  101,  but  which  is  seldom  utilized  by  99a  of 
today's  teachers.    How  many  teachers  ask  themselves  the  question:    What  do 
my  students  know  at  the  end  of  this  55  minute  class  period  that  they  did  not 
know  at  the  beginning  of  the  hour?  What  is  the  objective  of  this  lesson  today? 
What  are  the  entry  level  cognitive  skills  needed  by  my  pupils  in  order  to 
understand  today's  lesson? 

How  many  teachers  actually  set  aside  the  last  portion  of  each  class  period  to 
review  the  last  45  minutes?   How  many  teachers  tell  the  students  what  the 
next  class  period  will  involve?   Can  the  students  relate  each  lesson  with  a 
part  of  their  own  world? 

In  conclusion,  I  return  to  the  original  question  regarding  the  enhancement 
of  self-esteem:     What  set  of  conditions  must  be  present  in  the  classroom 
to  facilitate  or  bring  about  a  student's  sense  of  great  self-worth"? 

Does  the  achieving  of  excellence  and  the  knowledge  that  one  has  succwfSsfully 

completed  an  assignment  increase  self-worth?   Does  success  breed  success 

again  and  again?   Do  teacher  qualities  need  to  be  redefined  and  must  teachers  ) 

become  a  part  of  the  process?   Do  role  models  enhance  a  student's  desire  to 

strive  for  excellence  because  they  observe  that  excellence  is  achievable? 
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Is  there  nead  for  diversity  within  the  teaching  ranks  in  a  given  school? 
Should  teachers  be  matched  with  the  type  pupils  who  seem  to  thrive  under 
their  tutelage?   Are  the  "personality  types"  rewarded  for  getting  along 
with  their  colleagues  and  conversely,  are  the  introverted  teachers' 
effectiveness  in  the  classroom  often  unrewarded?   Are  teachers  evaluated 
by  persons  who  are  guided  by  a  set  of  criteria  that  is   just  and  fair  and 
more  importantly,  is  the  evaluation  process  designed  to  enhance  the 
educational  environment? 

Of  course,  it's  easy  to  answer  these  questions,  but  is  it  easy  to  set  up 
a  system  by  which  thjy  can  be  effectively  measured,  reported,    and  dissemi- 
nated to  the  classroom  teacher  and  the  administrator  in  those  remote  com- 
munities who  do  not  encourage  attendance  at  conferences  where  such  data 
is  reportea?    Is  it  now  known  the  percentage  of  educators  who  take  advantage 
of  educational  statistics  and  reports  such  as  those  published  by  NCES? 

I  intentionally  avoided  a  long  dissertation  on  the  issues  of  science  and 
mathematics  education  and  the  serious  lack  of  knowledge  of  the  usefulness 
of  these  academic  areas  to  the  present  and  future  lives  of  today's  students. 
It  seemed  self-serving;  as  I  am  a  publisher  of  math  and  science  curriculum 
materials.    However;  I  have  taken  the  liberty  to  include  as  an  appendix, 
some  new  information  recently  distributed  by  Howard  Adams,  of  GEM.  (  See 
reference  page  for  additional  information  of  Dr.  Adams).    U  seemed  vital 
to  share  this  information  as  part  oV  this  report.   Adams'  complete  report 
further  enhances  the  material  included  in  my  introduction  about  the 
relationship  between  role  models,  acadt^mic  success,  and  career  aspirations 
particularly  as  this  issue  relates  to  minority  studc'ts.    Problems  faced 
in  graduate  and  undergrauuate  school  must  be  addrpssed  in  elementary 
and  secondary  school. 

The  attempt  has  been  made  to  raise  questions  for  this  commendable  study 
undertaken  by  the  National  Center  for  Education  Statistics.  The  following 
suggestions  are  made  in  response  to  QUESTIONS  TO  PE  ADDRESSED  from 
Attachment  A: 


In  answer  to  question  #1,  please  refer  to  page  5  of  Attachment  B 
Public  School  Survey; 


ADD: 


Sumary  level 

PeriodJ.city 

Data  set  (198A  -85 


Characteristics  principals  seek  in 
hiring  new  teachers 

Characteristics  principals  seek  in 
evaluation  of  teachers 


Characteristics  teachers  believe  are 
important  in  hiring/evaluating  of  teachers 


Characteristics  needed  for  competent 
effective  teachers  as  described  by 
^  p  arents ,  cosmnuni  ty ,  s  tudent  s 

vniat  has  been  done  to  upgrade  Teacher 
Staff  Development  since  1980 (as 
O  IQl  perceived  by  teachers? 


O  7P7  perceived 

ERIC  ISii 


In  answer  to  question  02,  please  refer  to  page  (un-numbered  9) 

CURRENT  ELEMENTARY/'^ECONDARY  EDUCATION  DATA  ACQUISITIONS 


Under  Fall  Membership 
Public  by: 
Private  by: 

Percent  minority 


The  suggestion  is  made  to  specify  races » 
Black  children  are  quite  different  from 
Asian  Americans.  Asian  Americans  should 
be  delineated  by  number  of  years  in  USA. 
Asian  Americans  who  have  been  in  America 
for  ten  years  have  had  a  totally  different 
experience  from  those  newly  arrived  Asians. 

Many  economically  low  Asian-Americans  surpass 
Black  Americans  dcademically.    Their  lifestyles 
and  American  experiences  should  be  chronicled 
for  the  BENEFIT  of  many  Blacics  who  could 
perhaps  appreciate  "How  do  they  do  it?" 

Hlspanics  and  American  Indians  are  also  different 
from  Blacks  and  Asians,    The  point:    SPECIFY  RACE. 
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NuTES 


SOUNDS  OF  SCIENCE  is  a  science  curriculum  program  developed  by 
Carole  Hardeman  et.  al.    This  program  is  becoming  widely  used  in 
several  American  school  systems.    It  is  unique  in  that  it  features 
on  audio-cassette  the  lifestyles,  childhood  f»xperiences,  and  career 
information  of  successful  scientists  of  all  races,  persons  with 
physical  challenges,  and  over  fifty  percent  of  the  role  models  are 
women.    Although  career  based,  this  program  engages  students  in 
excellent  science  laboratory  activities  which  were  developed  by 
Otis  Lawrence,  Ph.D.,  Ray  Broekel,  Lh.D.,  and  Richard  Baim. 
Developed  at  the  University  of  Oklahoma,  the  program  is  now 
under  copyright  to  ADROIT  Publishing,  Inc. 

REFERENCES 


POWELL,  R.B.,(1984).    Why  is  Striving  for  Excellence  Important? 
The  Minority  Engineer/Winter  1984-85,  73-74 


BLOOM,  BENJAMIN,  All  Our  Children  Learning.  McGraw-Hill.  1981. 


APPENDIX 

ADAMS,  HOWARD  G. ,  Engineering  Education  for  Minority  Students;    A  Status 
Report.     (Dr.  Adams  is  Executive  Director  o£  National  Consortium  for 
Graduate  Degrees  for  Minorities  in  Engineering,  Inc.  (GEM) 
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APPENDIX 


TABLE  II 

FULL-TIME  FRESHMAN  ENROLLMENT  IN  ENGINEERING  BY 
ETHNICITY,  1973-1983 


YEAR 

TOTAL 

TOTAL 
MINORITIES 

BLACK 

HISPANIC 

INDIAN 

MO 

ft 

vi\j  .  1 

ft 

NO  • 

ft 

1973 

51,920 

^  f  7W  / 

2  130 

4  1 

1  5 

X  • 

67 

1 

1974 

63,440 

£  r  ^  ^  9 

4  ^ 

X  f  u  o  o 

1  7 
X  •  / 

105 
xu  ^ 

2 

1975 

75,343 

5,344 

7.1 

3,840 

5.1 

1,384 

1.8 

120 

.2 

1976 

82,250 

6,315 

7.7 

4,372 

5.3 

1,766 

2.2 

177 

.2 

1977 

88,780 

7,133 

8.0 

4,728 

5.3 

2,161 

2.4 

244 

.3 

1978 

95,805 

8,792 

8.7 

5,493 

5.7 

2,662 

2.8 

225 

.2 

1979 

103,724 

9,792 

9.4 

6,339 

6.1 

3 , 13  6 

3.0 

317 

.3 

1980 

110,149 

10,399 

9.4 

6,661 

6.1 

3,373 

3.8 

365 

.3 

1981 

115,280 

11,116 

9.6 

7 , 015 

6.i 

3,689 

4.1 

412 

.4 

1982 

115,303 

10,721 

9.3 

6,715 

5.8 

3,633 

3.2 

371 

.3 

1983 

109,638 

11,478 

0.5 

6,342 

5.9 

4^760 

4.3 

376 

.3 

Source:     Annual  Reports,   Engineering  Manpwer  Commission. 

PARITY;  Although  the  proportion  of  first  year  minority 
students  entering  engineering  has  risen  significantly  since 
1973,  the  gains  have  done  little  to  bring  about  parity  v/i th- 
in engineering  education.  When  *'The  Effort"  began «  under- 
represented  minorities  comprised  16.0  percent  of  the  popu- 
lation and  5.8  percent  of  first  year  engineering  enroll- 
ment (a  difference  of  10.2  percentage  points).  U.S.  Cansus 
data  for  1983  shows  that  the  minority  population  had  in- 
creased to  19.5  percent.  Engineering  first  year  enrollment 
for  minorities  in  1983  stood  at  10.5  percent.  The  percent- 
age difference  for  1983  between  population  and  first  year 
enrollment  was  9.0  percent. 
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TABLE  III 

POPUUTIOM  STATISTICS  AND  EHROllMCliT  FOR  MINORITIES  \H  EHGIHEERIHG 


1     1973    1     1974    1     1975  1 

1976 

i     1977  ! 

1     1976  1 

1   1979  1 

1960 

1961 

1  1902 

1  1963 

PopuUtfon  SUtlstfcs  (In  Thousands) 

Total 
PoDulatlon 

209.936 

212.227 

214.542 

216.683 

219.2S0 

221.642 

224.060 

226.505 

226.976 

231.474 

234. OOG 

MtiiorUy 
PoDulaMon 

34.769 

3S.735 

36.72S 

37.746 

36.797 

39.67S 

40.963 

42.122 

43.292 

44.495 

45.731 

Ptrccnt 

htnorlty 

16.6 

16.6 

17.1 

17.4 

17.7 

16.0 

16.3 

16.6 

18.9 

19.2 

19.5 

Minorities  As  a  Perccntaqe  of  First  Year  and  Total  EnrollMenl 

First  Year 
Enrol  laent 

S.8 

6.3 

7.1 

7.7 

6.0 

6.7 

9.4 

9.4 

9.6 

9.3 

10.5 

Total 
Enrollment 

4.6 

S.2 

5.5 

6.0 

6.1 

6.7 

7.0 

7.9 

8.3 

6.1 

6.4 

Minority  Paclplents  As  a  Percentacie  of  Total  Degrees  Awarded 

B.S. 

2.9 

3.5 

3.9 

3.9 

4.0 

3.7 

3.7 

4.1 

4.4 

4.5 

4.8 

4.S. 

l.S 

2.2 

2.0 

2.1 

2.2 

2.7 

2.3 

2.4 

2.6 

2.3 

2.9 

Ph.O. 

0.7 

0.9 

1.5 

1.2 

1.4 

1.7 

1.5 

1.6 

1.4 

1.4 

2.0  1 

Source:   Annual  Report*  Engineering  Manpower  CoNMl^slon  and  U.S.  Departiaent  of  Camerce,  Bureau  of  the  Census 
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To  reach  parity  with  popu2,ation  percentages r  all  minority 
constituent  groups  will  need  to  experience  inc .  iased  en- 
rollment rates.  Using  1983  Census  data  (Table  III)  for 
parity  comparisons,  minority  enrollment  should  be  19 .5  per- 
cent in  engineering. 


TABLE  IV 

FULL-TIHE  UNDERGRADUATE   ENGINEERING  ENROLLMENT 
BY  ETHNICITY,  1973-1983 


TEML 

TOTAL 
NO. 

TOTAL 
MINORITIES 

BLACK 

HISPANIC 

IND] 

[AN 

NO. 

« 

NO. 

% 

NO. 

% 

NO. 

% 

1973 

186,700 

8,558 

4.6 

'  5,508 

3.0 

.  2,769 

1.5 

.  281 

.1 

1974 

201,100 

10,530 

5.2 

6,287 

3.4 

3,380 

1.7 

323 

.2 

1975 

231,379 

12,828 

5.5 

8,389 

3.6 

4,111 

1.8 

328 

.1 

1976 

257,835 

15,412 

6.0 

9,818 

3.8 

5,138 

2.0 

446 

.2 

1977 

289,248 

17,753 

6.1 

11,388 

3.9 

5,747 

2.0 

618 

.2 

1978 

311,237 

20,729 

6.7 

12,954 

4.1 

7,150 

2.3 

625 

.2 

1979 

340,488 

23,999 

7.0 

14,786 

4.3 

8,454 

2.4 

759 

.2 

1980 

365,117 

28,944 

7.9 

16,181 

4.3 

11,860 

3.3 

903 

.2 

L981 

387,577 

32,196 

8.3 

17,611 

4.5 

13,615 

3.5 

970 

.3 

1982 

403,390 

32,711 

8.1 

17,598 

4.4 

14,035 

3.5 

1,078 

.3 

1983 

406,144 

34,126 

8.4 

17,817 

4.4 

15,182 

3.7 

1,127 

.3 

Source:    Annual  Reports:  Engineering  Manpower  Commission 

Trends  in  Full -Time  Total  rndergraduate  Engineering 
Enrollment  B;^  Ethnicity,  1973-1983 

Total  enrollment  for  all  engineering  students  increased 
from  186,700  in  1973  to  406,  144  in  1983.  During  the  same 
period,    total  minority  engineering    enrollment  rose  from 
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1973  to  3,817  in  1984  (Table  V).  As  a  percentage  of  total 
B.S.  degrees  awarded  in  engineering,  the  increase  was  from 
2.9  percent  in  1973  to  5.0  percent  in  1984. 

The  distribution  of  B.S.  degrees  among  minority  groups 
in  1973  was:  Blacks  1.5  percent;  Hispanics  1.3  percent;  and 
American  Indian  0.15  percent. 

Advanced  Degree  Graduates 


The  national  effort  to  address  the  underrepresentation 
of  minority  students  at  the  graduate  level  was  launched 
with  the  founding  of  the  National  Consortium  for  Graduate 
Degrees  for  Minorities  in  Engineering,  Inc.  (GEM)  in  1976. 


TABLE  V 


B.S.  Engineering  Graduates  in  The  United  States 
by  Ethnicity,  1973-1984 


Year 

Total 
B.S. 

Total 
Minorities 

Black 

Hispanic 

Indian 

No. 

% 

No. 

% 

No. 

% 

No. 

% 

1973 

43,429 

1,255 

2.9 

657 

1.5 

566 

1.3 

32 

.07 

1974 

41,010 

1,423 

3.5 

756 

1.8 

636 

1.6 

31 

.07 

1977 

39,718 

1,582 

4.0 

844 

2.1 

702 

1.8 

36 

.09 

1»78 

45,753 

1,679 

3.7 

894 

2.0 

748 

1.6 

37 

.08 

1979 

52,161 

1,943 

3.7 

1,076 

2.1 

808 

1.6 

59 

.11 

1980 

58,413 

2,383 

4.1 

1,320 

2.3 

1,003 

1.7 

60 

.10 

1981 

62,615 

2,728 

4.4 

1,445 

2.3 

1,193 

1.9 

90 

.14 

1982 

66,652 

3.007 

4.5 

1,646 

2.5 

1,270 

1.9 

91 

.14 

1983 

72,122 

3,493 

4.8 

1,862 

2.6 

1,534 

2.1 

97 

.13 

1984 

76,576 

3,817 

5.0 

2,022 

2.6 

1,683 

2.2 

112 

.15 

Source:    Annual  Reports*  Engineering  Manpower  Commission. 
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TA8LE  VI 

N.S.  ENGINEERING  GRADUATES  IN  THE  UNITED  STATES  BY  ETHNICITY 
1973-1964 


Year 

Total  H.S. 

Total 
Minorities 

Blacks 

Hlsoa 

American 
Indian 

No. 

If 

no. 

t 

m 

No. 

% 

No.i 

t 

1973 

17,152 

.  258 

1  .9 

.0 

139 

.8 

1974 

15.885 

IAS 

158 

1.0 

187 

1.2 

4 

.03 

1975 

15.773 

320 

2.0 

141 

.9. 

176 

1.1 

3 

.02 

1976 

16.506 

351 

2.1 

154 

.9 

183 

1.1- 

14 

.08 

l?77 

18. SSI 

364 

2.2 

147 

.9 

210 

1.3 

7 

.04 

1978 

16.162 

439 

2.7 

201 

1.2 

234 

1.5 

4 

.03 

1979 

16.036 

366 

2.3 

152 

1.0 

205 

1.3 

9 

.02 

1980 

17.229 

415 

2.4 

162 

.9 

249 

1.5 

4 

.02 

1981 

17.643 

466 

2.6 

182 

1.0 

276 

1.6 

8 

.05 

1982 

18.289 

414 

2.3 

164 

1.0 

215 

1.2 

15 

.08 

1983 

19.673 

580 

2.9 

258 

1.3 

306 

1.6 

16 

.08 

1984 

20.992 

636 

•3.0 

253 

1.2 

358 

1.7 

25 

.12 

TABL£  VII 

Ph.D.  ENGINEERING  GRADUATES  IN  THE  UNITED  STATES  8Y  ETHNICIH 

1973-1984 


Year 

ToUl  M.S. 

Total 
Nlnorltleet 

Blacks 

Hlsoa 

nic 

American 
Indian 

No. 

No. 

i 

No. 

X 

No. 

% 

1973 

3.S87 

26 

.7 

13 

.3 

12 

.3 

1 

.03 

1974 

3.362 

31 

.9 

12 

.4 

19 

.6 

0 

.00 

1975 

3.138 

47 

1.S 

17 

.5 

28 

.9 

2 

.06 

1976 

2.977 

35 

1.2 

10 

.3 

15 

.5 

0 

.00 

1977 

2.814 

39 

1.4 

16 

.6 

22 

.8 

1 

.04 

1978 

2.573 

43 

1.7 

15 

.6 

25 

1.0 

3 

.10 

1979 

2.815 

41 

1.5 

19 

.7 

22 

.8 

0 

.00 

1980 

2.753 

45 

1.6 

19 

.7 

25 

.9 

1 

.04 

1981 

2.841 

39 

1.4 

16 

.6 

20 

.7 

3 

.10 

1982 

2.644 

38 

1.4 

20 

.8 

15 

.6 

3 

.10 

1983 

3.023 

60 

2.0 

19 

.6 

41 

1.4 

0 

.00 

1984 

3.234 

49 

1.5 

24 

.7 

25 

.8 

0 

.00 

Source:   Annual  Reports.  Engineering  Manpower  Connlsslon 
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Underrepresentation  of  minorities  in  engineering  is  pri- 
marily caused  by  two  obstacles: 

1.  Lack  of  knowledge  about  engineering  as  a  profession? 

and/ 

2.  Lack  of  preparation  at  the  precollege  level  in  math 


For  the  first  area,  the  sparcity  of  professional  engi- 
neers within  the  minority  community  leaves  a  void  of  role 
models.  This . results  in  minority  youth  not  viewing  engi- 
neering as  a  viable  career  path  that  would  lead  to  success. 

The  second  area  is  caused  by  the  problems  minorities 
encounter  moving  through  the  educational  system  in  this 
country. 

Some  o£  these  problem  areas  are: 

1.  Attrition  from  the  pipeline — only  72  percent  of 
Black  and  55  percent  of  the  Hispanic  and  American 
Indian  students  complete  high  school  ixi^igure  I). 

2.  Curriculum   placement — only   28   percent   of  minority 

students  pursue  academic  programs  in  high  school. 
The  rest  are  in  either  vocacional  (32%)  or  general 
( 40%)  programs. 

3.  Course  Choice-*-* among  minority  high  school  students 


only: 

50%  take  Algebra  I 
35%  take  Geometry 
30%  take  Algebra  II  . 
15%  take  Trigonometry 

5%  take  Calculus 
25%  take  Chemistry 
20%  take  Physics 


The  coiq)lexity  of  the  problem  is  exacerbated  by  the 
manner  in  which  the  academic  abilities  of  minority  students 
are  viewed.    For  example: 

1.  The  educational  system  continues  to  use  negative 
counseling  when  advising  minority  students.  In  the 
counseling  process,  minority  students  are  too  £re^ 

•  quently  counseled  away  from  college  preparatory  pro- 
grams and  into  nonacademic  areas .  Thus ,  minority 
students  are  often  counseled  below  their  abilities. 

2.  Some  teachers  fail  to  challenge  minority  students  by 


teaching  down  to  what  they  perceive  to  be  the  level 
of  the  student.    In  their  efforts  to  offer  under- 


and  science. 


) 


standing^  they  actually  hinder  academic  growth  by 
telling  the  student,  "I  know  you  are  doing"^  the  best 
that  you  can  do. " 

3,  School  personnel  charged  with  counseling  and 
advising  minority  students,  too  often  associate 
learning  difficulties  with  the  economically  disad- 
vantaged. They  tend  to  think  that  if  a  child  is 
minority,  he/she  is  automatically  deprived  and 
therefore  probably  cannot  function  educationally. 

Because  of  these  and  other  negative  attitudes  about  the 
academic  abilities  of  minority  youth,  the  educational  sys- 
tem, in  spite  of  all  the  talk  about  change,  remains  ineffec- 
tive in  providing  these  students  with  a  sound  educational 
grounding  in  academic  subjects.  Thus,  75%  or  more  of  all 
minority  students  who  graduate  from  high  school  do  so  un- 
prepared to  gain  regular  admission  to  post-secondary  in- 
stitutions of  higher  learning.  That  is  why  the  work  that 
is  being  done  through  the  "Minority  Engineering  Effort" 
is  so  important  and  needs  to  be  strengthened,  expanded  and 
continued.  Future  consideration  needs  to  be  focused  on 
finding  ways  to: 

1.  Continue  support  for  public  education  which  is  paid 
for  by  taxes.  The  notion  of  a  voucher  system  of 
education  will  not  work  for  the  masses.  If  the  U.S. 
is  to  have  an  educated  populous,  it  will  have  to  be 
done  through  a  public  system  of  education. 

2.  Identify  academically  talented  minority  students 
early  in  their  education  and  counsel  them  into  both 
academic  curricula  and  courses  that  contain  pre- 
requisite preparation  for  college  level  work  in  en- 
gineering and/or  other  math-based  disciplines. 

3.  Have  teachers  and  administrators,  at  all  levels  of 
the  educational  structure,  become  positive  about  the 
abilities  of  minority  students.  In  so  doing,  they 
must  be  made  to  realize  that  neither  talent  nor  abil- 
ity is  defined  by  ethnicity.  They  must  be  made  cog- 
nizant of  the  fact  that  students  don't  start  out  as 
failures — rather .  the  system  designates  who  shall 
succeed  and  who  shall  fail.  Through  attitudes  and 
expectations,  the  system  conveys  to  minority  stu- 
dents what  is  perceived  as  their  chances  for  suc- 
cess. Studies  show  (Astin  1982,  Brooks,  1983)  that 
where  the  level  of  expectation  is  high  and  is  com- 
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Introduction 


This  reviw  of  tht  «lem«AtAry/secondary  school  data  program  of  the  National 
Center  for  Education  Statistics  (HCES)  was  approached  by  this  author  froca  a 
professional  badcgiTound  which  included  positions  as  teacher,  school  adninistratori 
educational  statistics  researcher,  and  manager  of  the  statistical  analysis  and 
education  statistics  information  branch  of  the  National  Center  for  Education 
Statistics  (NCES).    As  X  did  then,  I  believe  that  NCES  must  serve  the  school 
administrators  (State,  intermediate,  and  local),  the  Department  of  Educatim,  and 
the  inquiring  public,  which  includes  the  ordinary  taxpayer,  the  news  media »  and 
the  research  coomanity. 

The  collection,  analysis,  and  dissemination  of  needed  data  must  be  done  with 
an  eye  to  keeping  the  task  manageable  in  Washington,  and  the  burden  oa  respondents 
as  small  as  possible  while  producing  data  which  have  reliability  and  validity. 
All  these  purposes  can  be  served  by  increased  dependence  on  sa^le  surveys 
directed  by  knowledgeable  professional  educational  statisticians  and  with 
increased  cooperation  of  the  State  Departments  of  Education  (SDOE)  and  the  U.S. 
Department  of  Education.    The  problems  of  coiq>arability  of  data  between  States  and 
reliability  of  final  products  would  be  diminished  by  greater  use  of  sampling. 

For  example,  the  quagmire  of  average  salaries  of  teachers  could  be  managed  if 
an  educational  statistican,  who  understood  State  school  finance,  were  in  charge  of 
a  sample  survey  of  about  5,000  local  education  agencies  (LEA*s)«    The  sai9>le  size 
necessary  may  be  more,  or  less,  but  it  should  be  capable  of  producing  a 
distribution  of  average  salaries  of  teachers  by  size  of  district  and  by  State. 
Where  there  are  unusual  arrangements,  such  as  State  payments  directly  into  the 
teacher  retirement  funds,  a  small  research  project  would  be  presented.  However, 
if  the  researchers  were  working  with  a  small  number  of  survey  forms,  that  problem 
could  be  solved  by  a  system  of  attribution,  which  would  make  the  figures 
comparable  to  the  typical  State  figures. 

Similar  situations,  such  as  state  payments  for  construction  of  buildings  and 
payments  for  debt  service,  could  be  managed  by  attribution  techniques  to  make 
revenues  and  expenditures  coogparable  to  the  large  majority  of  independent  LEA's. 
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Data  Items  or  Data  Series  Needed 

The  1985  data  collection  program  as  presented  to  the  reviewers  is  impressive 
on  paper  and  most  of  the  work  seems  desirable;  however,  there  are  items  and  series 
for  which  there  may  be  little  need.    The  items  most  needed  are  those  that  describe 
schools,  school  districts  or  other  local  education  agencies,  pupils  (including 
information  about  completers,  dropouts,  and  graduates),  revenue  or  income, 
expenditures,  and  outcomes.    Much  of  this  information  can  be  had  from  records  in 
the  State  capitals. 

Schools  and  School  Districts.    Universe  maintenance  as  described  in  the  1985  NCES 
program  should  provide  sufficient  data  on  schools  and  school  districts.    While  it 
is  essential  to  have  these  universe  J.ists  and  to  keep  them  up-to-date,  the  data 
there  must  bs  readily  available  to  Departoen^  employees  and  other  researchers  on  a 
timely  basis  and  provisions  mnst  be  madm  to  provide  information  on  a  parchased- 
service  basis  as  needed  by  the  public.    The  maintenance  of  these  files  would  be 
further  justified  if  directories  were  produced  on  some  reasonable  cycle.    It  has 
been  about  seventeen  years  since  school  directories  were  published  by  the 
Department  and  USA  directories  cannot  be  counted  on  as  being  up-to-date.  LEA 
directoriss  should  Include  some  usable  information  such  as  enrollment;  number  of 
schools  by  type  or  grade  spaa;  numbsr  of  teachers;  and  expenditures  per  pupil. 

Enrollment  and  Attendance.    As  mmntioned  elsewhere,  tbs  current  NOES  daU  program 
presents  some  problems  of  terminology  or  nomenclature  which  should  not  be  entirely 
overlooked.    It  is  difficult  to  think  of  primary  and  pre-primary  pupils  as 
students,  irtiich  is  a  tern  traditionally  reserved  for  the  college  attendee. 
Likawise,  fall  membership  leaves  somsthing  to  ba  desired  when  referring  to 
enrollment  on,  or  near,  Octobar  1.    Membership  has  been  a  term  denoting  the 
average  nuabar  of  anroUeas  over  sons  period  of  time,  and  it  has  been  defined  in 
the  handbook  series.    At  any  rate,  accurate  enrollmant  by  grade  and  level, 
collected  annually  (periodically  by  sex  and  age)  is  vital  to  tha  statistics 
program.  ^  Average  daily  mambarship  (ADM) ,  and  average  daUy  attendance  (ADA) ,  are 
maasures  of  pupil  load  which  are  not  now  comparable  State  to  State  and  not 
available  in  some  areas.    These  are  things  the  Administrator  and  the  Chief  State 
School  Officers  should  atteq>t  to  define  and  make  universal.    Laadership  vital 
and,  in  soi.e  cases ^  State  legislatim  would  be  desirable,  e.g.,  ADA  in  California. 
It  is  amaming  that  California  has  not  corrected  this  unusual  situation  of  allowing 
pupils,  vith  valid  excuses,  to  b«  counted  as  present*    Over  the  years,  it  has  cost 
the  Stats  school  system  millions  in  federal  aid  money  -  Elementary  and  Secondary 
Education  Act,  title  X  (later  called  Chapter  Z),  and  School  Assistance  in 
Federally  Affected  Areas  (SAFA  or  X^ct  Aid).    ADM  and/or  ADA  are  the  only 
measures  of  pupil  load  which  will  sake  it  possible  for  researchers  and 
administrators  to  make  the  needed  comparisons. 

Class  size  ia  another  statlatic  needed  periodically  to  show  the  distribution 
of  the  pupil  burden  on  the  individual  teacher.    Pupil/teacher  ratio  is  not  a 
substituta  for  class  size  and  the  idea  of  making  that  substitution  should  be 
discouraged.    A  pariodic  survey  involving  a  small  sample  would  produce  a 
distribution  of  class  size  by  State,  and  need  not  be  dona  more  often  than  every 
three  to  five  years.    It  has  not  been  done  adequately  for  many  years. 
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several  other  sets  of  numbers  should  be  made  available  on  a  regular  basis 
through  sample  surveys  or  updates:    length  of  the  school  term»  compulsory 
attendance  ages,  pupils  transported,  and  enrollments  in  various  programs  or 
subject  areas. 

It  is  possible  that  some  of  the  items  mentioned  here  could  be  obtained  by  the 
Bureau  of  the  Census;  for  exan^>le,  enrollment  by  grade »  sex,  and  age. 


Employees 


Administrators .    Professional  administrators  should  be  accounted  for  in  at  least 
tvo  groups  ~  those  in  the  central  office,  and  those  vhose  activities  and 
locations  are  school'-centered.    Pull  time  and  full-time  equivalent  of  part  time 
would  be  needed,  as  well  as  the  salary  expense  for  the  tvo  basic  groups.  Adequate 
information  should  be  available  from  a  biennial  sample  survey  which  would  prodvce 
a  distribution.    The  periodicit/  could  be  longer  if  experience  shows  this 
popttlation  to  be  stabilized. 

Teachers.    The  number  should  be  collected  by  a  saiq>ie  survey  which  would  produce  a 
State-representative  distribution  by  en^loyment  status  ~  full  time,  and  full-time 
equiva^^nt  of  part  time.    The  associated  salary  e^enditures  should  be  collected 
biennial to  produce  good  figiures  on  average  salaries  of  teachers.    As  mentioned 
elsewhere  in  this  paper,  attribution  of  some  salary-related  itent  will  be  required 
in  a  few  States.    Additional  sample  surveys  at  intervals  of  about  four  or  five 
years  should  collect  data  on  teachers  by  sex,  by  assignment  emd  level,  by 
training,  and  by  years  of  teaching  experience.    It  is  conceivable  that  these  data 
could  be  collected  by  some  other  agency  such  as  the  National  Education 
Association,  but  they  should  be  institutional  data  as  are  almost  all  those 
discussed  in  this  review.  * 

Other  Professionals.    Data  are  needed  on  other  professional  employees  such  as 
guidance  workers,  psychologists,  and  librarians  at  the  same  level  of  detail  as  for 
teachers. 

Non->professional  (Classro^  associated).    Data  on  the  non-professional  employee  in 
the  classroom  should  be  approximately  the  same  as  for  the  teachers.    Csing  a 
sample  may  be  risky,  so  it  may  be  imperative  to  include  the  necessary  items  ^n 
some  universe  survey,  or  a  specially  designed  sa]q>le. 

Non^'professional  (Non-^classroom  associated).    a%ta  are  needed  periodically  on  the 
number  of  fiai"-time  equivalent  non-professional  employees  by  general  assignment 
(of fice*clerical,  maintenance,  cleaning,  bus  driver,  etc.).    Adequate  data  should 
be  obtainable  from  a  small  sample  after  gross  figures  have  once  more  been 
obtained. 
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High  School  Seniors,  Graduates,  and  Dropouts*    Data  on  the  study  programs  of  high 
school  seniors,  at  least  in  general  terms »  should  be  collected  and  analyzed  on  a 
periodic  basis.    The  number  of  graduates  and  the  general  area  of  their  studies 
should  be  made  available  by  State,  and  by  sex.    General  Educational  Development 
(GEO)  certificate  recipieat  data  must  be  reported  separately  from  those  who 
receive  regular  diplomas. 

Properly  designed  dropout  studies  should  be  done  at  regular  (3      4  years} 
intervals  through  the  use  of  a  sample  which  will  estimate  a  State  distribution  by 
size  of  school  system.    Reliance  on  the  retention  rates,  presently  the  only 
substitution  for  dropout  rates,  indicates  a  reluctance  to  attempt  a  difficult  task 
even  when  there  is  a  clamor  for  better  data  than  that  produced  by  NCES. 


Revenues  and  Expenditures 


Revenues.    Xncone  or  revenue  by  source  (Federal,  State,  intermediate,  local,  and 
other)  should  be  collected  and  reported  by  state.    A  distribution  by  size  oi 
school  systen  would  be  a  benefit,  even  if  available  only  every  four  years.  If 
State  aggregate  figures  are  not  easy  to  obtain  on  an  annual,  routine  basis,  a 
sanqple  study  every  other  year  should  be  adequate.    There  should  be  some  exhibit 
items  such  as  the  proportion  of  local  funds  froa  property  taxes.  Dependent 
districts  and  those  States  where  unusual  financial  arrangements  prevail  will 
require  that  momm  attribution  be  done  by  a  knowledgeable  educational  statistician. 
For  instance,  if  the  State  makes  contributions  directly  to  the  teacher  retirement 
system,  thos«  amounts  must  be  attributed  %o  the  salary  expense  item,  and  to  an 
appropriate  revenue  item. 

Non-revenue  receipts  should  be  available  by  state.    This  is  a  necessary  item, 
but  in  some  casern  eo  mxch  attribution  is  required  that  the  figures  should  be 
collected  biennially  or  less  frequently  unless  some  of  the  problems  can  be  solved. 
If  non -revenue  data  are  not  obtained,  the  total  picture  will  not  be  available. 

Expenditures .    The  various  financial  accounting  handbooks  and  their  revisions  have 
introduced  some  confusion  into  an  area  of  school  statistics  where  there  was  less 
than  total  agreement  before;  however,  even  the  most  recent  revision  allows  the 
collection  of  needed  data  since  there  have  been  no  major  changes  introduced  by  the 
1980  revision.    In  a  separate  section  of  this  ^^/iew,  there  appears  a  set  of 
comments  oo  the  NCSS  Common  Core  of  Data  (CCD)  which  i]q)inges  on  the  following 
list  of  items  that  should  be  available  in  all  school  systems  using  the  new 
handbook.    Some  combining  of  items  will  be  required  to  make  comparisons  with 
states  where  the  new  handbook  is  not  being  used. 
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Current  Expenditures 

Elementary/Secondary  Instruction  Programs 

Support  Services »  Instruction 
Attendance 
Guidance 
Health 

Psychological  Services 
Speech  Pathology 
Instructional  Staff 
Ot>jr  Instruction 

General  Adninistration 
Business  Services 
School  Administration 
Operation  and  Haintenance  of  Plant 
Transportation 

Facilities  Acquisition 

Capital  Outlay  for  Equipfflent»  Buildings,  and  Sites 
Interest  on  Long-Ten  Debt  Associated  with  Building 
Repayment  of  Principal  of  Long-Term  Debt 


Projections >    Most  of  the  items  detailed  here  should  be  included  in  a  complete  set 

of  projected  statisticm.    The  information  people  must  have  projected  statistics  — •  ) 

some  of  their  "customers"  will  not  take  "no"  for  an  answer.    Suppose  the  W>.ite 

House  asked  for  an  estimate  of  esqpenditures  for  public  schools  in  1988-89  and  the 

answer in  due  course »  vent  back.    Then  the  same  questioner  might  say  he  wanted  an 

estimate  of  elementary/secondary  enrollment  for  the  same  year.    These  answers 

better  "fit  together"  or  there  will  be  embarrassment  enoi«gh  for  everyone.  Without 

a  coordinated  set  of  projections,  these  questions  will  probably  not  be  handled 

correctly. 

The  information  staff  can  do  a  great  job  of  estimating  statistics  for  the 
current  year  and  maybe  the  next  year  or  two,  but  beyond  that,  too  much  demographic 
information  is  needed  for  them  to  have  a  good  answer  for  1995-96,  for  instance. 
Restarting  the  program  would  require  some  time  and  resources,  but  would  be  a 
worthwhile  expenditure. 


Outcomes.    Measurement  of  outcomes  is  a  morass  which  should  be  avoided;  however, 
many  inquirers  want  to  know  how  a  particular  ..chool,  school  district,  or  State 
school  system  ranks  with  others. 

The  Federal  or  State  governments  probably  should  not  design  a  testing  program 
to  make  these  outcor.^!  comparisons.  Those  States  with  graduation  test  requirements 
typically  agree  that  individual,  school,  or  school  district  data  will  not  be  made 
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public*    dov  could  a  national  achievement  test  be  given?    States  have  shown 
interest  in  expanding  the  sample  for  the  National  Assessment  of  Educational 
Progress  (MA£P)  to  obtain  State  representative  figures;  however,  these  are  not 
readily  made  available  to  the  researchers  or  news  media.    Xhey  don't  mean  much 
unless  Stata  estimates  are  obtained  for  all  States* 

It  nay  be  feasible  to  equate  e^xisting  test  results  through  the  techniques 
used  in  the  Anchor  Test  Study,  done  several  years  ago  by  Dr*  Charles  Hammer 
(NCES)|  where  results  of  eight  reading  achievement  testa  were  equated  so  that  one 
could  find  a  comparable  test  score  for  any  of  the  eight  tests  when  compdred  to  any 
other*    This  project  was  successful*  but  has  not  been  widely  used.    In  fact,  it 
has  been  used  hardly  at  all*    Could  the  States  agree  on  a  set  of  achievement  tests 
that  would  be  administered  by  each  state,  or  could  all  those  that  exist  be 
equated;  it  is  doubtful* 

This  is  the  kind  of  thing  the  Secretary  could  get  his  teeth  into  and  it  might 
even  work  for  him,  but  it  is  recommended  that  the  Center  remain  ready  to  help  but 
not^  lead* 


Comments 


Questions  and  Comments  about  CCD*    The  word  "membership"  has  always  been  cornected 
with  some  sort  of  average,  such  as  average  daily  membership,    Vihat  then,  is  fall 
membenhip  am  in  Part  X,  Public  School  Universe?    Obviously,  it  is  the  number 
enrolled  (m  or  near  October  1)*    Why  not  ask  the  schools  for  the  number  of 
full-time  classroom  teachers,  and  the  full-time  equivalent  of  part-time  classroom 
teachers?    The  response  burden  would  not  be  increased  because  these  numbers  are 
typically  known  separately*    The  data  tell  us  something  about  employment 
practices t  particularly  if  co^Mrad  over  a  period  of  time*    All  of  the  Part  I  data 
would  be  useful  in  a  set  of  school  directories  which  have  not  been  published  for 
about  seventeen  years*    The  data  are  available  from  computer  files,  but  that  is  a 
Poor  substitute  and  is  not  widely  known* 

Are  all  the  items  needed  for  sampling  available  in  Part  IX,  L£A  Universe,  or 
a  combination  of  Part  XX  and  Part  XXX,  LEA  Non-fiscal  Report?    Xn  Part  XXX,  LtK 
Non-fiscal  Report,  there  are  more  problems  with  nomenclature:    does  instructional 
staff  in«auda  guidance  personnel,  etc*,  as  has  been  traditionally  true?  Student 
membership  is  used  again  when  apparently  enrollment  is  what  will  be  given  by  the 
respondent*    There  may  be  a  problem  in  Part  XXX,  LEA  Non«*fiscal  Report  unless  the 
question  about  enrollment  is  asked  more  clearly  than  it  is  stated  in  the  list 
provided*    The  atteiqpt  hera  seems  to  be  to  get  at  part-tima  attendance  of  children 
below  the  first  grade*    Xt*s  better  to  ask  how  many  there  are,  and  the  length  of 
their  school  day,  then  do  your  own  arithmetic,  than  to  wonder  if  it  has  been  done, 
or  done  correctly.    A  regular  program  for  publishing  a  directory  of  the  Part  XI 
data  every  third  year  would  be  a  good  service*    It  would  be  a  better  service  if  a 
littxe  more  information  could  be  added,  such  as  fiscal  status  and  current 
expenditures  per  pupil*  » 
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Part  IV,  LEA  Finance  Report,  is  the  worst  example  in  CCD;  it  showw  a  lack  of 
understanding  of  the  ptoblena  and  presents  unworkable  solutions.     It  is  not 
necessary  (or  desirable)  to  obtain  these  items  every  year.    A  relatively  small 
saapU  iiill  produce  a  distribution  suitable  for  most    eeds,  most  years,  with  a 
census  tabulation  periodically  (three  to  five  years).    The  construction  of  the 
data  set  seems  to  assume  that  the  State  and  local  education  agencies  are  using  the 
Financial  Accounting  for  Local  and  State  School  Systems  manual  and  that  there  are 
severe  limitations  on  the  data  items  available.    First,  relatively  few  State  and 
local  systemr  are  using  the  manual.    Second,  there  i»  no  reason  to  omit  the  many 
functional  accounts  which  have  been  used  since  1957,  except  that  the  old  Auxiliary 
Services,  or  Fixed  Charges  account  no  longer  exists  ~  the  amounts  formerly 
collected  there  are  now  distributed  to  those  accounts  with  which  they  are 
associated.    Functional  account  data  should  be  available  since  Mr.  Barr  says  in 
the  Financial  Accounting  foreword,  "...it  does  not  make  --ajor  changes  in  the 
account  classification  system."    The  survey  director  will  need  to  know  (as  will 
users)  what  is  included  in  such  classifications  as  Instruction,  Attendance  and 
Health,  Operation  and  Maintenance  of  Plant.    Putting  these  accounts  together  is 
not  very  new  and  causes  researchers  no  serious  problem. 

Under  other  uses  of  public  funds,  more  items  are  needed.    For  instance,  it  is 
not  enough  U>  ask  for  debt  service,  it  is  necessary  to  know  interest  on  long-term 
debt  and  repayment  of  principal  separately.    If  construction  equals  capiUl 
outlay,  there  is  no  problem;  but  does  everyone  understand  this? 

There  seems  to  be  enough  siaUarity  in  the  State  aggregate  and  LEA  items  to 
make  a  charge  of  duplication,  yet  there  are  needed  items  in  both.    For  example. 
State  aggregate  current  expenditures  for,  or  on  behalf  of,  LEA's  should  be 
attributed  to  the  propar  program  in  the  LEA,  so  that  the  resulting  figures  will  be 
like  those  in  other  districts.    Examples  of  these  include  State  contributions  to 
teacher  retirement  funds,  State  expenditures  for  buildings,  and  financing  of  debt. 
Comparable  attributions  to  revenue  accounts  oust  also  be  made. 

Comi^ents  on  Sajg>le  Surveys.    The  sanqple  surveys  present  a  pretty  picture,  but  so 
far  the  private  school  survey  has  not  produced  usable  data.    It  appears  to  be  too 
ambitious  when  the  small  proportion  of  children  enrolled  in  private  schools  versus 
those  in  public  schools  is  considered.    To  a  person  with  little  knowledge  of 
saiiq»ling,  the  sampling  fractions  for  public  and  private  schools  seem 
disproportionate.    It  is  difficult  to  sea  what  wiU  be  learned  from  th<t  teacher 
demand  and  shortage  survey  unless  there  has  been  much  work  on  definitions  •  For 
example:    respondents  should  not  consider  a  vacancy  filled  i£  a  make-shift 
arrangement  has  put  a  poorly-qualified  and  poorly-motivated  teacher  in  a  classroom 
where  a  better  trained  individual  is  needed.    Some  of  these  surveys  have  produced 
valuable  d^ta,  but  an  estimate  of  the  distribution  by  State  is  needed  in  many 
instances. 

Comments  on  paper  by  Cooke,  Ginsburg.  and  Smith.    The  tone  of  "The  Sorry  SUte  of 
Education  Statistics"  strongly  implies  that  the  ills  of  education  statistics  are 
the  fault  of  things  done  by  NOES  along  with  some  things  not  done.  Unfortunately, 
there  is  some  truth  in  what  they  say;  however,  many  of  the  specifics  are  wide  of 
the  mark.    Exai^)le:    NOES  does  not  have  dropout  statistics,  but  there  is  no 
suggestion  that  the  retention  statistics  represent  a  substitute.    Bureau  of  the 
Census,  data  are  presented  in  the  Digest.    Example:    NCES  has  not  reported  on  class 
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size  for  many  years;  the  data  shown  in  the  Digest  are  pupil-teacher  ratios  which 
are  not  claimed  to  substitute  for  class-size  data.    Example:    Advocate  groups  such 
as  those  who  £avor  bilingual  education  tend  to  overstate  the  size  of  their  group 
which  may  well  be  enough  to  explain  the  differences  that  Cooke,  Ginsburg  &  Smith 
complain  about.  Exanqple:    When  one  says  that  there  is  a  300  percent  difference 
between  1.2  and  3*6,  anything  else  said  becomes  suspect. 


In  Conclusion 


This  review  does  not  present  a  detailed  list  of  data  items,  nor  does  it 
recommend  a  data  gathering  plan,  but  it  presents  soma  ideas  and  recollections  of 
problems  and  needs  in  providing  Information  service  over  a  number  of  years.  Even 
to  begin  to  do  what  has  been  suggested  here,  NCES  would  require  support  from 
Congress,  from  other  ^sers,  and  from  the  States.    Additional  and/or  different 
staff  would  be  required  to  do  some  of  the  work  —  particularly  the  research  and 
attribution  suggested  here. 

Research  on  the  measurement  of  outcomes  should  be  increased;  perhaps  the 
higher  education  commuaity  could  be  helpful,  or  perhaps  the  Chief' State  School 
Officers  or  others  may  have  expertise  to  lend  to  this  huge,  difficult,  sensitive 
task. 

It  is  difficult,  if  not  impossible,  to  guess  what  the  issues  and  data  needs 
might  be  in  1999.    If  the  trend  toward  greater  interest  in  schools  —  particularly 
by  parents  —  continues  or  increases,  many  factors  discussed  here  could  change 
drastically.    Not  the  least  of  these  would  be  interest  in  studies  of  class  size 
and  average  salaries  of  teachers,  as  well  as  items  which  describe  teacher 
fitness  — •  years  of  teaching  experience,  training,  test  scores,  etc.    Parents  are 
not  generally  impressed  by  top-heavy  administrative  staffing,  or  inflating  school 
bureaucracies,  or  the  accompanying  salaries.    Even  if  parents  don't  become  more 
interested  in  schools,  the  data  disciuised  in  this  review  will  continue  to  be 
needed  and  should  be  provided  by  the  only  appropriate  agency,  the  National  Center 
for  Education  Statistics. 


199 

207 


EDUCATIONAL  STATISTICS  AND  SCHOOL  IMPROVEMENT 


by 


Willis  D.  Hawley 


STATISTICS  AND  THE  FEDERAL  ROLE  iii  EDUCATION 


The  collectioD  aod  dissemioatioo  of  educatioDal  staciscics  have  beea  a 
federal  responsibility  for  almost  120  years.  The  federal  role  ia  education  has 
changed  considerably  since  then  and  the  demands  made  for  the  scope,  depth  and 
accuracy  of  information  have  increased  accordingly*  While  the  appropriateness 
of  the  federal  government's  role  in  tar  collection  and  provision  of  statistical 
information  is  not  seriously  questioned,  debate  about  what  and  how  data  should 
be  collected  is  recurrent.  The  reason  for  this  is  that  statistics  are  not  ends 
in  themselve8~they  support  and  facilitate  the  attainment  of  other  purposes. 
Many  of  these  purposes  are  controversial  and  involve  real  or  potential  conflict 
not  only  vithin  the  federal  government  but  among  different  levels  of  government. 
There  seem  to  be  four  broad  purposes  for  which  educational  statistics  are  used: 

1)  To  provide  information  on  conditions  and  trends  relating  to  the 
characteristics  and  performance  of  learners  and  educational 
institutions, 

2)  To  guide  the  allocation  of  resources, 

3)  To  assist  in  the  enforcement  of  laws  and  regulations  assuring 
students  freedom  from  racial,  ethnic,  gender  or  other  invidious 
discrimination,  and 

4)  To  facilitate  the  improvement  of  educational  policies  and  practices. 

Until  recently,  most  uses  of  educational  statistics  related  to  the  first 
three  of  these  purposes.  However,  the  current  surge  of  interest  in  educational 
reform  has  seen  policymakers  and  reformers  turn  to  educational  statistics  to 
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determine  how  effective  schools  have  been  and  what  Improvements  might  result  In 
the  greatest  Increases  In  student  learning.    And,  as  more  and  more  people  have 


of  available  information  have  become  more  apparent*  As  Cooke,  Glnsburg  and 
Smith  (1985)  point  out,  information  available  from  the  National  Center  for 
Educational  Statistics  (NCES)  is  often  inaccurate,  incomplete  and  inconsistent* 
NCES  has  no  monopoly  on  such  credits*  In  particular,  the  extant  information 
tells  us  too  little  about  the  outcomes  of  education.  And,  when  such  information 
is  available,  measures  that  might  account  for  differences  among  students  ^'jd 
school  systems  often  a^e  not* 

This  paper  focuses  on  how  educational  statistics  might  better  serve  the 
quest  for  educational  improvement  in  elementary  and  secondary  schools*  In 
seekiL^  answers  to  this  question,  I  briefly  identify  the  contributors  to  the 
federal  information  base  and  suggest  that  available  resources  could  be  better 
used.  I  then  turn  to  the  notion  that  if  we  want  statistics  to  serve  the 
Interests  of  educational  improvement,  we  need  to  conceptualize  the  sources  and 
processes  of  school  productivity.  Such  an  analytical  model  is  presented  and  the 
types  of  questions  suggested  by  this  framework  for  which  statistical  information 
could  provide  answers  ete  identified. 

Some  implications  of  this  approach  fo^  current  studies  undertaken  by 
federal  agencies,  especially  the  National  Center  for  Educational  Statistics 
(NCES),  and  for  future  inquiries,  are  explored.  I  conclude  by  arguing  that  the 
quality  of  educational  statistics  can  be  improved  if  (a)  statistical  survev3  are 
theory  driven  and  policy  focused  and  (b)  the  use  of  statistics  is  made  easier 
and  more  productive. 


sought  to  put  educational  statistics  to  work  in  the  cause  of  change,  the  limits 
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THE  RELATIONSHIP  BETWEEN  EDUCATIONAL  STATISTICS  AND  EDUCATIONAL  RESEARCH 
The  collection  of  educational  statistics  should  both  be  informed  by  and 
facilitate  research.    Statistics,  by  themselves,   seldom  tell  a  very  rich  story 
but  they  can  md  should  encourage  better  story  telling* 

I  use  the  term  research  here  to  mean  the  process  by  which  new  knowledge 
that  explains  why  things  happen  is  discovered.  To  believe  that  one  can 
understand  what  is  going  on  in  schools  by  knowing  the  characteristics  of 
schools,  even  if  one  knows  the  performance  of  students  in  those  schools,  is  to 
be  presumptuous  or  naive~or  both. 

Statistical  gathering  and  analysis  that  is  uninformed  by  research 
encourages  simplistic  conclusions  about  the  causes  of  student  performance. 
There  are  two  reasons  for  this.  The  first  is  that  important  variables  may  be 
omitted  from  the  data  sets  while  irrelevant  data  may  be  collected.  Requests  for 
information  that  few  people  will  or  could  use  makes  unproducf.ive  demauds  on  data 
providers  but  the  omission  of  variables  encourages  inappropriate  analysis.  A 
second  characteristic  of  statistical  information  the  collection  of  which  is  not 
informed  by  research  is  that  key  variables  may  be  inappropriately  specified  and 
measured . 

Data  that  have  benn  shaped  by  research  and  collected  with  theoretical 
concerns  f.n  mind  obviously  facilitate  research.  Both  the  extensive  utilization 
of  the  National  Longit-.udinal  Study  of  the  High  School  Class  of  1972  (NLS-72)  and 
the  limitations  of  these  analyses  makes  this  point.  In  comparison  to  the  NLS- 
72,  the  High  School  and  Beyond  (HSB)  Study  was  much  better  informed  by  research 
and  theory  and  the  potential  payoffs  from  analyses  of  these  data  appear  to  be 
enormous • 


Financial  resources  available  for  educational  research  are  meager.  At  the 
same  time,  there  Is  a  virtual  army  of  actual  and  potential  educational 
researchers  that  could  attack  "research-Influenced**  Information  on  education  In 
search  of  new  knowledge.  There  are  ways  that  the  energies  of  this  army  could  be 
enlisted  and  redirected  from  the  ubiquitous  mall  surveys  and  meaningless 
descriptive  studies  but  an  exploration  of  such  strategies  seems  to  be  the  topic 
of  another  papen 

Research  based  on  the  types  of  statistical  Information  typically  collected 
by  government  agencies  or  their  contractees,  eve;)  data  as  rich  as  those 
collected  In  the  HSB  Study^  can  tell  only  part  of  the  story.  Analysis  of  large 
scale  statistical  data  should  lead  to  and  be  Informed  by  more  Intensive  research 
that  examines  the  dynamics  of  student  and  teacher  Interaction  and  otherwise 
helps  us  to  avoid  false  assumptions  about  the  meaning  of  statistical  data.  For 
example,  the  Introduction  of  comprehensive  teacher  evaluation  plaos,  especially 
those  that  Involve  standardized  statewide  criteria  and  processes.  Is  one  of  the 
most  far--reachlng  reforms  ever  Introduced  In  American  schools*  But  It  Is  not 
the  presence  of  these  plans  or  even  the  putative  characteristics  of  the  plans 
that  will  explain  any  changes  In  teacher  behavior;  It  Is  the  way  these  plans  are 
Implemented  and  the  data  from  them  are  utilized  that  will  tell  the  tale.  One 
cannot  determine  how  as  evaluatlcd  system  (a  curriculum,  or  other  Innovations 
such  as  a  new  Instructional  method,  or  a  management  practice)  Is  Implemented  and 
how  context  affects  Implementation  without  using  research  techniques  that  are 
more  Intensive  than  statistical  surveys. 

In  summary,  research  and  statistical  surveys  should  he  neeo  as  having  a 
symbiotic  relationship.  This  Is  particularly  true  with  respect  to  statistics 
that  might  Inform  decisions  about  school  Improvement. 


ERIC 


THE  UNDERUTILIZATION  OP  EXISTING  CAPACITY 


The  National  Center  for  Educational  Statistics  collects,  directly  and 
Indirectly,  only  a  portion  of  the  Information  that  might  be  relevant  no 
educational  Improvement.  Within  the  Department  of  Education,  a  host  of  other 
data  collection  efforts  are  regiilarly  undertaken.  These  Include  various  policy 
studies  and  program  evaluations  conducted  or  supported  by  the  Office  of  Planning 
Budget  and  Evaluation;  research  and  Information  collected  by  line  agencies  such 
as  the  Office  of  Special  Education  and  the  Office  of  Bilingual  Education  and 
Minority  Language  Affairs;  the  National  Center  for  Research  on  Vocational 
Education  and  the  National  Institute  for  Research  on  the  Handicapped;  The  Office 
for  Civil  Rights;  and  various  programs  within  the  National  Institute  of 
Education,  Including  the  National  Assessment  of  Educational  Progress  (NAEP)« 
This  llet  Is  by  no  means  exhaustive.  The  point  Is  that  an  enorm  3us  amount  of 
Information  Is  collected  on  American  education  but  there  Is  no  central  effort  to 
plan  or  coordinate  the  Information  collected  or  even  to  consolidate  It  once  It 
Is  collected.  This  Is  not  to  argue  that  all  data  collection  efforts  within  the 
Department  of  Education  should  march  to  the  same  drummer.  But,  the  virtual 
absence  of  past  efforts  to  define  the  Information  needs  of  the  educational 
Improvement  mission  of  the  Department  of  Education  denies  the  Department 
opportunities  to  Inform  the  country  and  Influence  policy.  Various  mechanisms 
have  been  employed  over  the  years  to  -control-  data  gathering  efforts  but  these 
have  been  focused  primarily  on  the  reduction  of  paperwork  and  other  burdens 
Imposed  on  data  providers  rather  than  on  Improving  the  quality  and  accessibility 
of  Information. 

Given  the  absence  of  efforts  to  plan  and  coordinate  data  collection  and  to 
consolidate  statistical  data  within  the  department.  It  Is  cot  surprising  that 
the  education-related  data  collection  efforts  undertaken  by  other  federal 
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agencies  are  not  part  of  a  comprehensive  plan  and  that  data  are  not  assembled  In 
one  place.  Among  the  agencies  that  regularly  collect  Information  that  Tilght  be 
helpful  In  understanding  and  facilitating  school  Improvement  are  the  National 
Science  Foundation,  the  Department  of  Labor ^  the  Department  of  Health  and  Huiran 
Services,  the  Department  of  Commerce  (especially  the  Bureau  of  the  Census),  and 
the  Department  of  Defense. 

The  Secretary  of  Education  could  take  the  Initiative  In  designing  a  master 
plan  for  education-related  statistics  that  would  encompass  the  statistical 
activities  of  all  of  the  agencies  Identified  above.  The  first  step  in  that 
regard  would  be  to  catalog  current  and  planned  programs.  The  second  step  would 
be  to  Identify  the  key  variables  upon  which  major  studies  focus  and  the  uses  to 
which  the  data  ar<&  part.  A  logical  outcome  of  such  an  initiative  would  be  the 
establishment  of  a  Federal  Interagency  Advisory  Committee  on  Educational 
Statistics.  Such  a  committee  could  be  staffed  from  the  Office  of  Educational 
Research  and  Improvement.  As  Interagency  effort  could  (a)  identify  sources  of 
data  (b)  suggest  how  existing  data  can  be  intsgrated  (c)  identify  areas  of 
unnecessary  hindrance  and  important  issues  about  which  data  are  needed  and  (d) 
provide  advice  to  the  developers  of  major  new  efforts  to  collact  educational 
information.  *  One  difficulty  that  will  confront  such  an  effort  is  that  the 
Department  of  Education  is  a  minor  player  in  the  statistics  collection  game;  it 
does  not  have  a  lot  to  trade  with  when  it  seeks  cooperation.  But  the  interest 
in  education  is  great  now  and,  at  least  for  the  short  term  future,  the 
possibility  for  collaboration  may  exist. 


*    NCES  has  regularly  included  representatives  from  the  Census  Bureau  and  the 
Bureau  of  Labor  Statistics  on  its  advisory  board  and  this  seems  to  have  been 
constructive. 
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States  and  localities  generate  much  of  the  data  collected  by  the  federal 
governmeot.  lo  addition,  states  and  localities  collect  a  great  deal  of  ^ 
information  that  does  not  now  become  part  of  the  federal  data  base.  The  growth 
in  the  capacity  of  non-federal  education  agencies  to  generate  and  analyze  data 
appears  to  have  been  extensive  in  the  last  few  years.  These  "unassembled"  data 
have  potentially  significant  uses  in  fostering  school  improvement  but  this 
potential  is  undermined  by  the  absence  of  standardized  definitions  of  key 
variables,  variation  in  the  information  collected  from  state  to  state, 
differences  in  data  collection  processes  and  the  difficulty  of  retrieving  the 
data  collected. 

A  good  example  of  the  weaknesses  of  current  stAtn  level  data  is  provided  by 
information  about  teacher  supply  and  demand.  At  a  time  when  teacher  shortages 
are  widely  anticipated,  states  presumably  would  find  it  valuable  to  know  how 
their  policies  shaping  supply  and  demand  compare  lo  effectiveness  to  those  of 
other  states.  Some  comparative  data  oo  state  policies  are  available  (cf.  Roth 
and  Mastaio,  1984).  However,  data  on  the  consequences  of  these  policies — e.g. 
number  of  certified  teachers  seeking  employment,  the  qualities  of  these  teacher 
candidates,  who  actually  enters  the  profession,  the  volume  of  reentry,  and  the 
rate  and  character  of  teacher  attrition— -are  hard  to  come  by  even  though  such 
data  are  available  for  states  to  secure# 

The  federal  government  could  take  the  lead  in  encouraging  and  even 
assisting  In  the  collection  of  policy**relevant  information  on  the  supply  and 
demand  for  teachers.  One  mechanism  for  planning  such  an  initiative  is  the  not 
overworked  Intergovernmental  Advisory  Council  on  Education.  NCES  could  be 
responsible  for  implementation.  J 
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A  THEORETICAL  FRAMEWORK  FOR  SPECIFYING  STATISTICAL  DATA 
RELATED  TO  THE  IMPROVEMENT  OF  SCHOOLS 
Like  data  analysis,    data  collection  related  to  school  Improvement  should  be 
guided  by  two  central  questions: 

1«    What  are  the  problems  or  Issues  we  want  to  understand  better? 

2«    What  theory  or  theories  might  best  Identify  the  range  of  facf^rs  that 


If  the  answer  to  the  first  of  these  general  questions  Is  to  know  how  to  most 
cost--effectlvely  Improve  schools,  the  answer  to  the  second  question  depends  on  how 
we  would  decide  a  school  had  Improved.  I  suggest  that  the  central  purpose  of 
schools  Is  to  produce  student  learning.  Thus,  Improvement  would  be  measured  In 
terms  of  amounts  or  rates  of  learning  or,  at  least.  In  terms  of  the  relative 
achievement  of  students  once  all  of  the  variables  schools  cannot  Influence  are 
taken  Into  account*  I  will  return  below  to  the  types  of  learning  In  which  we  might 
be  Interested. 

OVERVIEW  OF  THE  MODEL 

The  effectiveness  of  most  organizations  that  are  In  the  business  of  producing 
something  Is  the  consequence  of  the  Interaction  of  five  types  of  factors: 

o  the  clarity  and  specificity  of  goals  being  pursued  (e«g«  student  academic 


Influence  the  outcomes  In  which  we  are  Interested? 


achievement) , 


o 


the  nature  of  the  raw  materials  (e.g.  the  potential  for  learning  students 


bring  to  school). 


o 


the  sophistication  and  appropriateness  of  the  technology  or  means  of 


production  (e«g«  the  curriculum),  and 


o 


the  quality  of  the  craftmanshlp  (e.g.  teacher  behavior) 


u 


''environmental'*  conditions  that  facilitate  or  Impede 


productivity 
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within  this  framework,  the  specific  variables  to  be  measured  will  have  to  be 
Identified.  I  will  suggest  a  number  of  tne  key  factors  that  current  research  ^ 
suggests  accounts  for  variation  In  student  achievement  from  classroom  to  classroom 
and  from  school  to  school.  This  model  Is  based  on  an  extensive  recent  review  of 
research  synthe  s  and  Individual  studies  (Hawley  and  Rosenholtz,  1984).  The 
relative  Importance  of  these  factors  for  enhancing  student  achievement  has  been 
affirmed  by  a  report  urging  school  reform  prepared  by  thirty-two  school 
superintendents  from  around  the  country  (National  Consortium  on  Educational 
Excellence,  1984). 

There  are,  of  course,  other  efforts  to  synthesize  current  research  on 
school-  effectiveness  (cf.  MacKenzle,  1983;  Brophy  and  Good,  forthcoming;  Purkey 
and  Smith,  1983;  Northwest  Regional  Education  Laboratory,  n.dO*  While  there  Is 
substantial  overlap  In  the  conclusions  reached  In  these  reviews,  there  are  also 

) 

differences.  Moreover,  the  model  presented  below  Is  derived  from  research  on 
student  achievement  measured  In  conventional  terms  (l*e.,  tests  of  skills  and 
knowledge)  and  that  Is  a  significant  limitation.  The  -Learning  Productivity 
Model**  outlined  here  should  be  considered  Illustrative.  It  seems  to  be, 
however,  a  useful  starting  point  In  Identifying  the  types  of  statistics  that 
will  be  most  helpful  In  understanding  and  facilitating  school  Improvement. 

Because  scholars  disagree  about  the  major  determinants  of  school 
effectiveness  and  because  the  Importance  of  different  factors  depends  on  the 
outcome  of  schooling  with  which  one  is  concerned,  the  model  or  models  which 
would  guide  federal  data  collection  and  coordination  efforts  should  be  derived 
from  a  consensus  of  leading  researchers  and  practitioners*  The  process  by  which 
such  consensus  might  be  developed  Is  not  difficult  to  Imagine:  experts  shoxxld  j 
be  selected  by  a  snowball  reputatlonal  technique  and  they  should  be  provided 
with  alternative  assumptions  about  variables  and  their  Interrelationships.  The 
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process  should  be  interactive  until  agreement  is  reached  either  about  particular 
^  variables  or  alternative  explanations  for  specified  outcomes-  Thus, I  have 

chosen  not  to  try  to  detail  specific  variables  about  which  one  might  want 
statistical  data  but  instead  to  pose  questions  which  direct  attention  at  the 
types  of  data  that  would  be  useful  in  assessing  and  fostering  school  improvement. 

The  Learning  Productivity  Model  of  school  effectiveness  focuses  attention 
on  schools  and  classrooms.  This  seems  an  appropriate  strategy  for  organizing 
one's  thinking  about  school  improvement  given  the  substantial  evidence  that 
change  that  affects  the  quality  of  education  children  experience  must  be 
generated  at  the  school  level  if  it  is  to  have  a  significant  and  continuing 
influence  (Hawley  and  Rosenholtz.  1984.  Ch.  1).  Moreover,  the  frequency  with 
which  one  sees  schools  of  widely  different  quality  within  the  same  district. 
^  even  if  one  takes  into  account  differences  in  student  body  characteristics. 

reinforces  the  idea  that  school  improvement-related  data  should  provide  well 
textured  pictures  of  schools.  However. a  number  of  environmental  conditions 
create  the  context  for  school  improvement  and  need  to  be  considered. 

The  types  of  factors  that  influence  school  productivity  and  their  dominant 
interrelationships  are  summarized  in  Figure  1.    Table  1  identifies  key  variables 
that  comprise  each  of  these  factors.    Before  turning  to  a  discussion  of  these 
variables  and  the  directions  they  point  to  with  respect  to  the  collection  and 
provision  of  statistical  information,  the  issue  of  educational  outcomes  needs  to  be 
addressed. 

The  national  interest  In  school  improvement  obviously  requires  that  we  focus 
on  the  ability  of  schools  to  produce  certain  outcomes  in  the  form  of  student 
^  learning.      I   want   to  distinguish  between   these   school  outcomes   from  the 

consequences  of    formal  learning.    I  will  refer  to  the  latter,  for  lack  of  a  better 
ErJc  *•  "lifetime  outcomM".  217 


SCHOOL  OUTCOMES.  There  appears  to  be  widespread  agreement  on  the  Importance 
we  should  attach  to  the  acquisition  of  so-called  "basic  skills'*  and  knowledge  about 
the  more  or  less  traditional  subject  matter  m^csured  by  tests  like  the  National 
Assessment  of  Educational  Progress,  the  Achievement  Tests  and  Advanced  Placement 
Tests  administered  by  the  Educational  Testing  Service,  and  various  standardized 
tests  which  report  student  performance  In  terms  of  grade  level  equivalencies* 

There  Is  growing  concern,  however,  reinforced  by  the  poor  showing  of  students 
on  tests  of  so-called  **hlgher  order  skills",  that  our  schools  are  falling  to  teach 
students  to  reason  Inf eren tlally,  to  engage  In  reflection  about  and  systematic 
analysis  of  complex  problems,  and  to  be  creative  In  the  face  of  uncertainty* 
Assumptions  about  the  Importance  of  these  and  similar  capabilities  to  the  life 
chances  of  Individuals  and  to  the  economic  and  social  health  of  the  society  have 
yet  to  be  tested*  But,  there  can  be  little  doubt  that  Interest  In  these  types  of 
school  outcomes  Is  growing.  There  can  also  be  little  doubt  that  there  Is  an 
absence  of  consensus  not  only  about  how  to  measure  these  outcomes  but  how  to  talk 
about  them  vitb  shared  meaning*  It  follows  that  little  Is  known  about  how 
variations  In  curricula  and  Instructional  practices  relate  to  these  outcomes* 
Thus,  the  federal  government  could  contribute  to  enlarging  the  definition  of  school 
effectiveness  If  It  could  facilitate  the  development  of  clearer  conceptions  of  the 
outcomes  by  which  the  effectiveness  of  schools  might  be  measured*  The  Importance 
of  such  an  effort,  which  could  take  the  form  of  conferences  and  relatively  simple 
studies  of  expert  and  leaders*  opinions.  Is  significant  T)ecause  It  Is  possible— as 
Cooke,  Glnsburg  and  Smith  (1985)  observe~that  the  factors  that  maximize  student 
performance  on  tests  of  basic  skills  may  not  produce  other  types  of  student 
learning,  such  as  •^higher  order  skills"**  Indeed,  some  researchers  believe  that 
scae  elements  of  the  technology  of  schooling  that  produces  learning  of  the  so- 
Q       called  basics  may  constrain  other  learning* 
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LIFETIME  OUTCOMES.  Educators,  policy-makers  and  parents  have  debated  the 
priorities  that  schools  should  emphasize  since  there  have  been  public  schools. 
The  nation  seems  to  swing  between  different  priorities  with  the  various 


another  will  have  on  the  experiences  and  well-being  of  students  once  they  leave 
school  (cf.  Ravltch,  1983).  Almost  all  of  this  advocacy,  however.  Is 
unburdened  by  evidence  about  the  relationship  between  variations  In  school 
experiences  and  differences  In  students*  post-school  outcomes. 

While  It  might  be  argued  that  curricula  should  reflect  the  values  of 
society,  or  the  community,  or  the  parents  Independent  of  the  extrinsic 
consequences  they  might  have  for  students,  this  Is  an  unsatisfying  position 
seldom  asserted  by  the  advocate  of  different  currlcular  emphases.  Thus,  It 
seems  appropriate  that  the  Information  ve  have  about  America's  educational 
systems  Include  data  that  would  allow  us  to  understand  how  differences  In 
content  and  levels  of  Investment  lead  to  differences  In  outcomes  beyond  academic 
performance  and  educational  attainment* 

Two  obvious  educational  outcomes  that  It  seems  useful  to  know  about  are 
occupational  success  and  Income*  The  Importance  of  such  Information  Is 
underlined  by  a  recent  synthesis  of  studies  that  concludes  that  Individuals* 
academJ^  performance  (as  measured  by  grade  point  averages  or  standardized  test 
scores)  hav?  almost  no  relationship  to  occupational  success  (Samson,  et  al*, 
1984)*  The  central  theme  of  this  review  of  research  Is  reinforced  by  another 
recent  study  showing  :that  a  large  national  sample  of  employment  officers  place 
like  emphasis  when  making  hiring  decisions  place  little  emphasis  on  most  of  the 
academic  outcomes  of  education  that  schools  are  now  being  asked  to  focus  upon 
more  Intently  (Grain,  1984)* 

Other  nooacademlc  outcomes  of  schooling  that  might  help  resolve  some  of  the 


advocates  Invariably  making  assertions  about  the  effects  thac  one  focus  or 


ERLC 


211 


recurrent  debates  about  curricula  and  thus  focus  reforms  oo  courses  of  study 
which  benefit  students  are: 

o    participation  In  the  political  and  social 
life  of  conmunltles 

o    Incidence  of  antisocial  behavior 

o    family  stability 

o  condition  of  physical  and  mental  health 
The  Importance  of  considering  the  goals  of  schools  and  the  priorities 
attached  to  them  Is  critical  lo  understanding  the  potential  for  school 
Improvement  In  any  given  school  or  school  system*  The  current  educational 
reform  movements^  for  example^  rests  on  the  assumption  that  the  quality  of 
schools  has  declined,  rhe  evidence  supporting  this  assumption  Is  conflicting^ 
however  J  (cf.  Smith,  1984,  Haw  ley,  forthcoming)  If  we  focused  attention  on  how 
well  the  schools  did  between  1970  and  1980  lo  (a)  promoting  basic  skills,  (b) 
meeting  the  special  needs  of  the  disadvantaged  and  the  handicapped,  (c) 
Increasing  the  number  of  students  who  did  well  on  Advanced  Placement  Tests,  and 
(d)  reducing  the  dropout  rate  and  Increasing  the  number  of  students  who  attend 
at  least  some  college,  the  schools  would  have  to  be  Judged  moderately  effective* 
If  we  ask  how  well  schools  did  In  teaching  Inferential  reasoning  and  science,  or 
developing  students'  understanding  of  democratic  process,  most  schools  would 
have  to  be  Judged  to  have  declined  In  effectiveness.  If  the  explanation  for 
Improvements  and  declines  have  to  do  with  how  schools  allocated  time  and  other 
resources  rather  than  how  well  they  used  them,  the  Implications  for  school 
Improvement  would  obviously  be  very  different.  This  rather  simple  notion  that 
the  current  dissatisfaction  with  schools  the  result  of  IncL'eased  and/or 
different  expectations  rather  than  declines  In  school  quality  has  received 
almost  no  attention  In  the  contemporary  public  discourse  about  education  In 
part,  perhaps,  because  there  has  been  little  evidence  on  how  school  outcomes  are 
related  to  differences  In  the  priorities  given  to  particular  goals  and  the  way 
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these  goals  have  been  pursued* 

( 

Recognizing  that  the  factors  that  affect  school  productivity  may  vary 
depending  on  the  outcome  being  focused  upon,  let  me  Identify  the  general  types  of 
Influences  that  current  research  suggests  determine  student  learning*  The 
statistical  Information  that  seems  to  be  both  useful  and  feasible  to  obtain  about 
each  of  these  Influences  Is  Indicated  by  a  set  of  questions  that  need  better 
answers  than  ve  now  have.  Recall  that  the  Learning  Productivity  Model  has  five 
sets  of  Interactive  variables — goals^  raw  materials,  technology,  craftsmanship  and 
environmental  conditions.  Each  of  these  will  be  considered  In  turn.  I  will  not 
cite  the  literature  that  links  these  variables  to  student  learning,  unless 
otherwise  noted.  The  reasons  for  believing  that  these  factors  and  others  related 
to  the  question^  posed  sre  Important  determinants  of  school  outcomes  are  documented 
elsewhere  (Hawley  and  Roseoholtz,  1984). 

(  .  . 

THE  GOALS  OF  SCHOOL  IMPROVEMENT 

RELATIONSHIPS  BETWEEN  GOALS  AND  OUTCOMES.  Organizational  goals  typically 
focus  on  products  or  processes.  For  our  purposes,  product  goals— the  types  of 
learning  we  want  to  produce^^should  be  our  concern.  It  might  well  be  Interesting 
to  koow  the  fit  betweeo  process  goals  and  the  processes  actually  being  utilized  but 
If  we  know  the  latter,  which  we  would  If  we  collected  data  on  the  elements  of  The 
Learning  Productivity  Model,  we  will  have  this  type  of  statistical  Information 
abot.t  the  processes  that  are  relevant  to  school  Improvement. 
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^  THE  LEARNING  PROOUCTIVITT  MODEL  -  r~T  FACTORS  APFECTINC  SCHOOL  EPFECTtVENESS 


OPPORTUNITY  ENVIRONMENT 


AUTHORITY 


CRAFTSPERSOH 


TECHNICAL 


CLIMATE 


RAW  MATERIALS 


TECHNOLOGY 


FINANCIAL 


gUPPORT  ENVIRONMENT 


OUTCOMES 
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TABLE  I 


KEY  ELEMENTS  OF  THE  LEARNING  PRODUCTIVITY  MODEL  OF  SCHOOLING 

GOALS 

1.  CONTENT 

2.  CLARITY 

3.  POCUS 

4.  CONCENSUS 

CHARACTERISTICS  AND  QUALITY  OP 
RAW  MATERIALS/STUDENTS 

'  I.  COGNITIVE  CAPABILITIES  " 

2.  ACQUIRED  KNOWLEDGE 

3.  MOTIVATION 

4.  OUT-OP-SCHOOL  RESOURCES  POR  LEARNING 

5.  OUT-OF-SCHOOL  CONSTRAINTS  ON  LEARNING 

TEE  TECHNOLOGY  POR  PRODUCING  LEARNING 

1.  INSTRUCTIONAL  STRATEGIES 

2.  ORGANIZATIONAL  ARRANGEMENTS  (EXAMPLES:    CLASS  SIZE, 

3.  CURRICULUM 

4.  TIME 

5.  LEARNING  RESOURCES  (EXAMPLES:    TEXTS,  MATERIALS, 
TECHNOLOGY,  ETC.) 

CRAFTSMANSHIP 

1.  ABILITY  AND  COMPETENCE 

2.  CONDITIONS  THAT  FACILITATE  THE  USE  OP  COMPETENCE 

3.  MtrriVATION 

ENVIRONMENTAL  CONDITIONS 

1.  OPPORTUNITIES 

2.  RESOURCES 


224 

215 


One  rather  straightforward  definition  of  an  effective  school  is  that  it  is 
a  school  which  achieves  its  goals.  In  this  sense  outcomes  and  goals  can  be  the 
same.  In  order  to  understand  the  sources  of  school  effectiveness,  however,  it 
will  be  useful  to  know  the  characteristics  of  the  goals  to  which  school 
personnel  subscribe* 

CHARACTERISTICS  OF  GOALS.  There  are  at  least  four  characteristics  of  the 
goals  to  which  individuals  in  a  school  might  profess  commitments  that  appear  to 
be  theoretically  related  to  productivity*  The  first  of  these  is  the  intensity 
with  which  people  subscribe  to  particular  priorities.  For  example,  two  people 
may  say  that  reading  achievement  is  their  first  priority  but  one  may  feel  that 
reading  supersedes  all  else  by  several  orders  of  magnitude.  For  another,  both 
reading  achievement  and  math  achievement  may  have  high  priority  even  though  math 
is  ranked  lower  thao  reading.  Saying  that  both  individuals  give  their  first 
priority  to  reading  Is  misleading.  Most  ways  of  assessing  priorities,  however, 
use  simple  ranking  procedures*  (What  Is  Deeded  here  is  something  like  the 
"tenperature  scales'*  developed  In  the  voting  studies  conducted  by  the  Institute 
for  Social  Research  at  the  University  of  Michigan.) 

A  second  dimension  of  goals  that  is  relevant  to  student  learning  is  the 
clarity  with  which  their  advocates  can  describe  them.  How  precise,  in  other 
words,  are  the  outcomes  being  sought?  Do  seemingly  similar  goals  subscribed  to 
by  different  teachers  have  the  same  meaning  for  each  teacher  when  the  specifics 
are  elaborated? 

A  third  aspect  of  goals  about  which  data  might  be  gathered  is  focus. 
Theodore  Sizer  may  overstate  it  when  ha  says  that  the  three  most  important 
things  in  explaining  school  effectiveness  are  focus,  focus  and  focus.  But  the 


ERLC 


point  Is  well  taken  (cf,  Peters  and  Waterman,  1983,  vls-a-vls  the  Importance  of 
focus  In  private  organizations.)  In  other  words,  hov  many  high  priority  goals 
do  teachers  and  administrators  in  a  school  want  to  accomplish? 

A  fourth  characteristic  of  goals   which  appears   to  influence  school 
effectiveness  is  how  widely  shared  the  goals  are* 

THE  RAW  MATERIAL  OF  EDUCATION  -  STUDENTS 

Students  are  the  raw  material  with  which  schools  work.  StudeowS  brin^  with 
them  to  school  different  capacities,  knowledge  and  motivation  for  learning  and 
the  effectiveness  of  schools  cannot  be  measured  unless  these  things  are  taken 
into  account.  Moreover,  schools  can  shape  their  probabilities  of  success  by 
influencing  the  learning  readiness  of  students.  Ideally,  we  would  want  to  know 
something  about  the  intellectual  capacity  of  students  but  this  is  difficult  to 
^  assess  validly  under  any  circumstances  and  seems  beyond  the  reach  of  statistical 

surveys.  Other  factors  that  schools  might  influence  or  that  could  be  influenced 
directly  by  public  policies  are  students'  previous  knowledge,  students' 
motivation,  the  resources  and  assistance  students  have  available  out  of  school, 
and  home  or  neighborhood  constraints  on  learning.  Thus,  we  might  better 
understand  the  effectiveness  of  schools  and  the  promise  of  different  improvement 
strategies  If  we  had  data  that  spoke  to  the  following  questions. 

What  was  the  performance  of  the  students  in  their  previous  school  or  class 
with  respect  to  the  outcomes  In  which  we  are  interested?  What  is  the 
socioeconomic  status  of  the  students?  What  types  of  preschool  learning 
experiences.  If  any,  did  students  have?  What  types  of  learning-relevant 
interactions  do  students  have  with  their  parents,  older  siblings  and  other 
^  adults  with  whom  they  spend  considerable  time?    What  proportion  of  the  students 

ar«t  fruift  wlugltt  parent  famlliea  uuu  uuw  many  have  u  ^^veat  at  houe  when  ticliool 
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Is  out?  What  does  the  school  and  teachers  do  to  Involve  parents  In  the 
education  of  their  own  children?  How  much  and  what  kind  of  homework  do  students 
do  and  under  what  conditions  can  they  study  at  home?  What  kind  of  supports  for 
and  constraints  on  learning  are  there  In  the  students*  immediate  neighborhood? 
How  much  time  do  students  spend  watching  television  and  what  do  they  watch? 

THE  TECHNOLOGY  OF  EDUCATION 

When  students  go  to  school  they  experience  a  range  of  structures,  processes 
and  learning  resources*  These  *means  of  production**  ~whlch  obviously  vary 
considerably  among  states,  school  districts,  schools  and  classrooms-*-make  up  the 
technology  of  schools*  Of  course,  the  effectiveness  of  the  technology  In 
producing  student  learning  Is  significantly  Influenced  by  how  well  It  is  used 
but  we  can  make  pollcy^and  do~about  what  I  am  calling  technology  more  or  less 
Independently  of  the  policies  ve  make  that  affect  the  quality  and  performance  of 
teachers  and  administrators* 

Data  collected  by  NCES  and  other  federal  agencies  are  typically  short  on 
Information  about  what  actually  happens  lo  schools*  The  HSB  data  go  a  long  way 
In  addressing  this  limitation  of  available  statistical  evidence  but,  of  course, 
they  tell  us  only  about  high  schools  at  two  points  In  time*  The  types  of 
Information  about  school  technology  that  research  suggests  would  be  helpful  In 
assessing  school  productivity  and  developing  Improvement  strategies  Include  data 
on  Instructional  strategies,  organisation  arrangements,  curriculum,  the  use  of 
time,  and  learning  resources*  Some  of  the  questions  we  would  want  this 
Information  to  address  are  set  out  below* 


INSTRUCTIONAL  STRATEGIES*    What  mix  of  strdtegies---such  as  whole  class  ) 
teaching,  programmed  Instruction,  Individualized  learning,  cooperative  learning, 
mastery  learning,   peer  tutoring  and  Interactive  teachlng-*-*ls  employed  and  how 
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does  this  vary  by  subject  matter  and  learning  objectives?  How  often  are 
students  evaluated  and  how  are  decisions  made  about  movement  through  the 
curriculum  and  grade  levels?  Uov  high  and  how  clear  are  standards  of  student 
performance  and  what  types  of  rewards  do  students  receive  for  meeting  standards? 

ORGANIZATIONAL  ARRANGEMENTS.     What  is  the  class  size  with  and  without  teacher 
aides?    How  many  students  are  there  in  the  school  and  how  are  they  assigned  to 
instructional  units  (e.g.  grades  or  "houses"  or  blocks)?    What  grouping  and 
tracking  procedures  are  employed?     What  is  "skewoess"  of  student  performance  in 
particular  classrooms? 

CURRICULUM.  What  subjects  are  taught^  at  what  level  of  difficulty  and  for 
how  many  hours  each  day  or  week.  Does  the  school  have  a  core  curriculum  that  is 
well  articulated  across  grade  levels?  Are  the  tests  used  to  measure  student 
performance  articulated  with  the  curriculum? 

TIME.  How  many  hours  of  actual  instruction  are  allocated  each  week  free 
from  interruption?  How  many  hours  do  teachers  teach  each  week?  How  many  days 
each  year  do  students  attend  school? 

LEARNING  RESOURCES.  What  Is  the  condition  and  nature  of  the  instructional 
facilities?  What  support  systems  do  teachers  have— library,  volunteers,  audio- 
visual, business-school  linkages,  etc.— and  how  often  are  they  available  and 
used?    How  many  computers  are  available  and  how  are  they  used? 

THE  QUALITY  OF  THE  CRAFTSPERSON 

A  decade  or  so  ago,   researchers  and  policymakers— but  not  parents— asked 
questions  like  *'do  teachers  make  a  difference"?    The  recent  outpouring  of 
O  „    research  on  school  effectiveness  leaves  little  doubt  that  both  teachers  and 
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administrators  make  a  big  difference  In  the  quality  of  education  students 
receive,  (cf.  Hawley  and  Rosenholtz,  1984,  Chs.  1-3).  For  example,  not  only  do 
teachers  Influence  how  students  learn  by  the  way  they  implement  a  curriculum, 
teachers  also  shape  what  students  are  taught  (Brophy,  1980;  Green  and  Barker, 
1982).  Recent  research  also  txtggests  that  teachers  significantly  Influence 
parental  Involvement  in  their  children's  education  (Epstein,  1984). 

Statistical  data  about  educators  is  very  limited.  It  is  not  possible,  for 
example,  to  get  a  clear  idea  of  what  the  career  paths  of  principals  and 
administrators  look  like  under  different  circumstances.  Little  is  known  about 
the  qualities  of  those  who  actually  teach  or  what  difference  these  qualities 
make  in  student  performance  (cf.  Evertson,  Hawley  and  Zlotnik,  1985).  Very 
little  is  known  about  teacher  attrition.  And  so  on.  (The  current  activity 
within  NCES  to  develop  a  better  picture  of  teachers  is  ambitious  and  well 
conceived  and  it  will  be  much  welcomed  by  policymakers.  A  similar  effort  with 
respect  to  school  administrators  is  also  needed.) 

There  are  three  interrelated  aspects  of  craftsmanship  which  appear  to 
influence  student  learning:  ability  and  competence,  conditions  that  facilitate 
or  impede  the  use  of  competence,  and  motivation.  Some  questions  to  whiah  it 
seems  important  ^o  have  answers  about  these  interrelated  aspects  craftsmanship 
follow. 

ABILITY  AND  COMPETENCE.  What  are  the  levels  of  general  academic  ability 
and  subject  matter  knowledge  that  teachers  and  principals  possess?  How  much  of 
what  types  of  formal  training  have  teachers  and  principals  had  and  at  what  stage 
of  their  career  did  this  training  occur?  How  many  and  what  kind  of 
opportunities  for  Increasing  their  professional  competence  have  te^^chers  and 
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prlDclpals  had?     What  opportunlcles  have  teachers  and  principals  had  to  learn 
Informally  from  their  peers? 

MOTIVATION.  What  priorities  do  teachers  say  they  give  to  the  different 
reasons  why  they  teach?  What  Is  the  volume  and  character  of  feedback  about 
their  performances  that  teachers  and  administrators  receive?  Is  there  a  formal 
evaluation  system?'  What  are  Its  criteria  and  how  Is  It  used?  What  Is  the 
salary  range  that  Is  accessible  and  on  what  bases  are  salary  Increases  awarded? 
Are  there  financial  Incentives  available  other  than  salary  Increases?  Do 
teachers  and  administrators  have  an  opportunity  to  participate  In  key  decision 
affecting  professional  practice?  In  what  ways  Is  superior  professional 
performance  recognized  and  rewarded  (besides  economic  rewards)? 

CONDITIONS  THAT  FACILITATE  EFFECTIVE  PRACTICE.    What  level  of  support  do 
^  teachers  and  administrators  receive  from  their  respective  administrative 

superiors?  How  often  do  teachers  have  the  opportunity  to  interact 
professionally  with  their  peers  and  do  corms  of  collegiallcy  exist?  What  is  the 
level  of  order  and  discipline  in  the  school?  Is  the  teaching  time  of  teachers 
protected  from  interruptions  and  diversion?  How  widely  shared  are  goals  for 
student  learning  and  at  what  levels  of  expectation  are  these  goals  pitched? 
What  are  the  number  of  students  in  the  school? 

It  should  be  noted  that  NOES  has  focused  increasing  attention  on  teachers  in 
recent  months  and  several  surveys  have  sought  to  collect  data  about  teachers  and 
what  they  do.  While  this  effort  addresses  several  of  the  questions  raised  above, 
the  bits  and  pieces  apparently  cannot  be  aggregated  and  too  little  attention  is 
focused  oo  outcomes.  The  HSB  data  do  pr  vide  student  outcome  data  but  little 
information  about  teachers'  careers  and  personal  characteristics.  The  NCES  labor 
^  market  survey  provides  information  about  teacher  shortages  and  teacher  incentive 

plans  but  no  information  about  salaries. 
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ENVIRONMENTAL  CONDITIONS  ^ 

The  problem  of  controlling  for  non-school  factors  that  affect  the 
productivity  of  a  school  cannot  be  dealt  with  adequately  except  under 
experimental  conditions*  Therefore,  the  theory  that  guides  data  collection  must 
encompass  critical  student  characteristics  beyond  the  reach  of  the  school  and 
aspects  of  the  schools'  ecology.  Much  has  been  written  about  the  factors 
external  to  individual  schools  that  influence  school  improvement* 
Unfortunately,  aside  from  a  handful  of  case  studies,  little  emperical  research 
00  the  relative  importance  of  these  factors  exists.  Thus,  unlike  other 
dimensions  of  the  Learning  Productivity  Model,  this  one  is  not  researched-based. 

The  collection  of  data  relating  to  school  external  environments  is 
problematic  not  only  because  so  little  evidence  is  available  upon  which  to 
select  from  among  the  theoretically  interesting  ecological  factors  that  could 
influence  student  learning  but  because  of  the  difficulty  of  acquiring  the 
information.  If  we  were  to  constrain  the  collection  of  data  to  those  that  could 
be  provided  by  occasional  national  samples  or  by  school  systems  from  existing 
information  bases,  the  types  of  information  relevant  to  school  improvement  that 
might  be  collected  seems  a  bit  easier  to  think  about. 

It  seems  reasonable  to  think  of  environmental  conditions  that  influence 
school  productivity  as  being  of  two  broad  types:  (a)  conditions  that  grant  or 
constrain  the  opportunities  of  educators  and  students  and  (b)  resources 
available  with  which  educators  and  students  can  pursue  their  goals. 


THE  aPPORTUNITY  ENVIRONMENT.    The  opportunity  environment  essentially  ) 
shapes  ambitions  and  expectations  and  grants—formally  or  informally— authority 
to  act.    Its*  dimensions  and  their  consequences  might  be  understood  if  questions 
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such  as  the  following  could  be  answered.  How  much  decision-making  discretion  do 
school  administrators  and  teachers  have  to  make  and  Implement  policy?  How  much 
support  do  the  goals  of  school-level  personnel  have  among  district-level 
administrators  and  other  teachers?  How  stable  are  residential  patterns  and 
pupil  assignments  to  schools?  How  available  to  students  are  low-cost  options  to 
pursue  postsecondary  education?  What  types  of  of  employment  opportunities  in 
the  community  can  students  expect  to  have  upon  graduation? 

THE  RESOURCE  ENVIRONMENT.  The  resources  available  to  pursue  the  ambitions 
and  expectations  held  by  individuals  and  by  the  collective  professional  and 
student  populations  of  school  should  affect  student  learning.  Resources,  of 
course,  create  opportunities  but  the  ^^opportunity  environment"  just  noted 
relates  to  sources  of  motivation  provided  by  the  environment  while  the  ""resource 
environment""  provides  capabilities  that  facilitate  action  relevant  to  the 
individual  and  organizational  purposes  that  have  been  discussed  as  deriving  from 
factors  that  characterize  the  school  and  its  student  body. 

The  nature  of  the  resource  environment  might  be  understood  if  answers  were 
available  to  several  questions-  What  is  the  level  of  expenditures  per  pupil 
taking  into  account  the  number  of  students  with  needs  for  resource-ii3tensive 
programs?  What  is  the  quality  and  quantity  of  technical  assistance  available  in 
the  district  to  implement  school-level  goals?  How  many  individuals  participate 
in  school  activities  as  volunteers  in  support  of  instructional  or 
extracurricular  activities?  What  resources,  if  any,  are  provided  to  schools  by 
business  and  public  and  nonprofit  agencies?  What  is  the  ""tax-effort"  (the 
extent  to  which  the  available  tax  base  is  utilized)  of  the  state  and  the  school 
district?  This  last  indicator  may  be  a  surrogate  measure  of  the  school 
environment's  commitment  to  public  education. 
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SUMMARY 

I  have  argued  tbzt  the  collection  o<=  statistical  da\  ated  to  school 

Improvement  should  be  guided  by  grounded  theories  and  hypotheses  that  might 
explain  differences  In  student  learning  among  schools  and  classrooms.  A 
conceptual  framework  Implicitly  embodying  such  explanations,  which  I  have  called 
the  Learning  Produc*"lvlty  Model,  has  been  outlined.  Identifying  the  key 
elements  of  models  and  questions  that  might  profitably  guide  data  collection  and 
analyses  does  not,  of  course,  add  up  to  specific  recommendations  about 
priorities  that  should  be  placed  on  gaining  particular  Information  that  would 
facilitate  the  development  of  effective  school  Improvement  strategies*  And, 
obviously,  the  ways  oach  variables  might  be  measured  are  only  hinted  at  In  the 
discussion  above.  My  presumption,  however.  Is  that  these  next  steps  In  the 
development  of  a  plan  for  collecting  statistical  Information  Is  given  direction 
by  this  model  building  exercise. 


CONCJSION     NEXT  STEPS 

Let  me  conclude  by  briefly  discussing  two  courses  of  action  which  would 
result  In  statistical  data  bases  that  would  support  the  formulation  of 
productive  school  Improvement  policies  and  practices:  (a)  the  development  of  a 
plao  for  collecting  new  types  of  data  (b)  the  Integration  and  enrichment  of 
existing  statistical  Information. 

THE  COLLECTION  OP  NEW  DATA 

In  general,  statistical  data  related  to  education  that  Is  now  available  Is 
not  particularly  helpful  In  developing  new  policy.  The  current  array  of 
educational  statistics  focuses  primarily  on  the  condition  of  education  rather 
than  on  explanations  for  that  condition.    In  other  words,  little  effoL*t  has  bean 
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made  to  relate  educatloaal  processes  to  educatloaal  outcor^s.  Moreover^  as 
noted  above,  when  outcomes  are  assessed,  the  range  of  educational  outcomes 
measured  Is  narrow.  For  example^  the  1985  Teacher  Questionnaire,  while  It  deals 
with  how  teachers  spend  their  time,  barely  touches  on  the  teacher 
character,  itlcs^  behavior^  and  circumstances  most  powerfully  related  to  student 
learning  and  provides  no  outcome  data  whatsoever  about  either  students  or 
teachers.  Of  what  value  Is  such  Information?  If  It  does  lead  somewhere,  the 
probability  that  It  will  lead  us  down  primrose  paths  Is  at  least  as  great  as  the 
^ospect  that  the  road  It  will  direct  us  to  will  be  paved  with  yellow  brick. 


This  generalization  about  the  atheoretlcal  character  of  data  collection 
^*Moe8  not  apply  to  all  surveys.  The  most  notable  exception  Is  the  HSB  Study. 
There  are  lessons  that  this  study  has  for  new  data  collection  efforts  relating 
to  school  Improvement  even  though  that  Is  not  the  primary  purpose  of  the  study. 
First,  schools  should  be  seen  as  social  systems  and  both  formal  and  Informal 
processes  should  be  assessed.  Second,  an  expert  review  panel  that  guides  the 
design  and  redesign  of  statistical  studies  seems  to  be  cost-effective.  Thus,  the 
next  step  would  be  to  convene  such  a  panel,  refine  the  theoretical  framework, 
specify  variables,  consider  the  sampling  Issues  and  otherwise  develop  the  scope 
of  the  project  so  that  the  potfintlal  benefits  and  the  costs  can  be  estimated. 
Ad  HSB-type  study  wllx  be  very  expensive  hxit  the  return  on  Investment,  In  terms 
of  usable  knowledge  and  educational  Improvement  will  probably  be  high.  If  early 
evidence  on  the  use  of  the  HSB  Study  Is  any  Indication.  Comprehensive  data 
collection  efforts  like  the  HSB  ^tudy  or  a  similar  one  which  would  follow  from 
the  Learning  Productivity  Model  vould  be  much  more  valuable  to  policy  makers  and 
would-*be  ref::*"mers  If  data  were  collected  that  would  allow  analysts  to 
understand  the  economic  costs  of  alternative  Improvement  strategies. 


ERLC 


B  Jtause  the  statistical  error  that  threatens  all  data  analyses  Is  reduced 

"5  234 


to  the  extent  that  one  can  take  Into  account  all  of  the  alternative  explanations 
for  a  given  phenomenon^  and  because  ve  typically  want  large  data  sets  to  serve 
multiple  purposes^  an  obvious  problem  faced  by  those  who  design  statistical 
studies  is  knowing  what  data  NOT  to  collect.  The  potential  cost/benefit  ratio 
of  data  collection  itself  is  one  way  to  make  such  decisions  and  theory  as  veil 
as  long  run  utilization  studies  can  be  used  to  make  such  calculations*  The 
probable  reliability  of  the  data  is  another  factor  that  should  be  considered  and 
it  would  seem  useful  to  develop^  perhaps  through  expert  interviews,  an 
understanding  of  the  sources  of  error  In  survey  responses  that  could  be  used 
across  studies.  For  example,  such  considerations  might  include  the  probability 
that  individuals  would  perceive  themselves  or  a  goal  they  value  being  advanced 
(or  the  converse)  by  accurate  provision  of  data  and  the  degree  to  which  the 
information  is  readily  available. 

THE  INTEGRATION  AND  ENHANCEMENT  OF  EXISTING  DATA 

I  have  argued  that  most  statistical  surveys  provide  only  part  of  the 
picture  we  need  to  have  of  how  schools  operate  and  the  outcomes  they  produce. 
This  proposition  holds  for  statistics  that  address  issues  other  than  school 
improvement.  There  are  good  reasons  for  this  having  to  do  with  cost,  burdens  on 
providers,  etc.,  but  among  the  several  studies  conducted  or  sponsored  by'the 
federal  government,  there  are  many  pieces  of  the  puzzle.  Moreover,  several 
studies  could  be  enriched  if  data  available  from  published  sources  other  than 
statistical  studies  were  added  to  various  data  sets.  NCES,  therefore,  might 
consider  the  following  strategies  for  making  available  statistics  and 
recurrently  conducted  studies  more  accessible  and  more  usable: 


(a)    coordinate  the  data  gathering  of  agencies  within  the 


Department  of  Education,  across  the  federal  government. 


and  between  federal  agencies  and  other  levels  of  government* 
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(b)  "oest**  future  studies  In  such  a  way  that  data  from  the  same 
sites  could  be  integrated*    For  example,  it  might  be 
possible  to  conduct  the  HSB  and  National  Assessment  studies 
in  the  same  or  overlapping  locations* 

(c)  identify  common  sites  at  which  data  has  already  been 
collected.    For  example,  the  teacher  supply  and  demand  study 
may  have  been  conducted  in  locations  for  which  data  on 
teacher  salaries  were  collected • 


(d)    enrich  existing  statistical  data  by  adding  information  from 

other  sources.    For  example,  the^. teacher  demand  and  shortage  study 
could  be  enhanced  by  adding  Information  on  career  entry 
requirements  (available  from  The  National  Association  of  State 
Directors  of  Teacher  Educational  Certification). 


Steps  such  as  these,  coupled  with  efforts  to  prepare  the  data  In  formats 
that  are  well  documented  and  readily  usable  by  researchers  and  practitioners, 
would  Increase  the  frequency  and  sophistication  with  which  educational 
statistics  were  analyzed.  The  nore  analysis  that  Is  carried  out,  the  more  Will 
be  known  about  the  strengths  and  weaknesses  of  the  data  collected.  Such 
knowledge  would  result  In  Improvements  In  the  quality  of  the  data  collected  In 
future  studies. 


SO,  WHO  WILL  FUND  ALL  OF  THIS? 

What  I  have  called  for  In  this  paper  could  easily  be  dismissed  as  being 
beyond  the  resources  of  the  Department  of  Education  and  therefore  unfeasible* 
^  Surely,   anyone  who  suggests  more  federal  activity  these  days  would  seem  to  be 

out  of  touch.    There  are  two  general  ^'ays  to  respond  to  the  legitimate  concerii 
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about  new  expenditures.  The  first  of  these  is  to  do  more  by  making  better  use 
of  current  resources.  The  second  is  to  convince  policymakers  that  spending 
money  on  statistics  will  not  only  Improve  learning  but  will  facilitate  more  cost 
effective  policy  decisions.  Let  me  consider  the  second  of  these  arguments 
first. 

It  Is  worth  noting  that  the  Office  of  Management  and  Budget  (0MB)  often 
-discourages"  statistics  gathering  proposals  on  the  grounds  that  they  lack 
policy  relevance.  What  Is  being  proposed  here  Is  to  Increase  the  relevance  of 
statistics  to  policy  making. 

All  levels  of  government  expend  about  $120  billion  on  public  elementary  and 
seco0dar>  education.  The  NCES  budget  Is  an  Infinitesimal  proportion  of  this  and 
If  the  costs  of  all  other  education  data  gathering  efforts  were  added  up,  the 
relative  level  of  Investment  In  statistics  would  still  be  minuscule.  If  the 
Information  developed  from  the  types  of  school  Improvement-related  data  I  have 
urged  be  collected  were  to  better  Inform  the  decisions  of  one  large  school 
system,  the  cost  of  the  national  effort  might  be  covered.  Among  the  types  of 
decisions  that  might  yield  large  dollar  returns  that  could  be  Informed  by  the 
sophisticated  analysis  of  quality  data  of  the  sort  discussed  above  are  choices 
about  class  size,  beginning  teache.  salaries^  the  use  of  economic  Incentives, 
Investments  In  traditional  staff  development  and  other  matters.  Of  course, 
analyses  could  point  us  toward  higher  expenditures  but.  If  so  this  would  result 
lo  greater  productivity.  If  Investments  In  schooling  could  be  tied  to  post* 
school  outcomes,  the  potential  for  return  on  the  Inventment  In  statistics  would 
be  very  great.  Of  course,  statistical  data  seldom  provide,  by  themselves,  clear 
policy  directions.  But  they  can  challenge  myths,  they  can  suggest  new  options, 
they  can  confirm  predispositions  and  they  can  Identify  Issues  worth  further 
Investigation.    Moreover,  when  cynics  charge  that  statistics  can  be  misleading 
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and  often  provide  Incomplete  pictures  the  answer  might  be:  compared  to  what? 
Most  policy  choices  are  made  on  the  basic  of  intuitions  Informed  by 
predispositions  and  by  the  concern  decisionmakers  for  their  political  and 
occupational  futures.  Good  statistics  can  serve  as  a  balance  wheel,  if  not  a 
sf,eering  wheel,  in  the  policy  process. 

What  about  making  do  with  the  resources  we  have?  To  pursue  the  course 
suggested  in  the  heart  of  this  paper,  it  would  be  desirable,  perhaps  necessary, 
to  conduct  ODe  study  a  year  of  the  size  and  sophistication  of  a  "wave**  of  the 
HSB  Study.  Hulti-*year  longitudinal  research  does  not  seem  necessary  though,  of 
course,  that  too  would  be  valuable.  O^e  possible  source  of  those  funds  is  to 
discontinue  work  being  done  now  that  does  not  seem  to  go  anywhere.  In  addition, 
it  might  be  feasible  to  combine  resources  from  several  of  the  NIE  centers  whoss 
missions  overlap  the  purposes  to  which  school  improvement"*re levant  statistics 
could  be  put. 

It  might  also  be  possible,  especially  in  view  of  the  recent  position  of  the 
chief  state  school  officers  to  use  the  NAEF  data  comparatively,  to  connect  the 
study  of  school  processes  in  some  way  to  the  outcomes  being  studied  in  the  NAEP. 
This  would  probably  require  in  a  larger  sample  and  Increased  cosLs  to  conduct 
the  NAEF  but  such  piggy^backlng  would  reduce  the  overall  expense  of  the  school 
improvemeot  study  even  if  this  study  bore  the  Increased  costs  of  the  NAEF. 
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If  a  major  new  study  or  set  of  studies  was  not  possible,  two  other  options 
remain.    One  is  for  NCES  to  take  the  technical  lead  and  provide  some  financial 
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incentive  that  would  encourage  separate  state  studies  that  would  be  conducted, 
in  part,  in  accord  with  a  common  design  and  with  common  basic  variables  being 
measured,  k  second  option  would  be  to  do  those  several  things  noted  earlier  in 
the  conclusion  related  to  making  more  effective  use  of  existing  data. 

Where  there's  a  will,  •  •  • 


References 

Brophy,  J.E.    (1980).    Teachers'  cognitive  activities  and  overt  behaviors 

(Occasional  Paper  No.  39).    E.  Lansing;    Michigan  State  University^  Institute 
for  Research  on  Teaching. 

Brophy»  J.E«>  &  Good»  TJi.,   (1974).    Teacher-student  relationships:    Causes  and 

consequences.    New  Tork:  Bblt»  Rlnehart  &  Wilson.  ) 

Brophy»  J.E.>  Monlas,  J.»  &  6ood»  T.L.    (In  press).    "Teacher  Behavior  and 
Student  ilchlevement/  In  M.  Wlttrock  (Ed.).    Handbook  of  Research  on  Teaching 
(3rd  ed.).    New  Tork:  MacMlllan. 

Cooke>  C,  Glnsburgy  A.>  &  Smlth»  M.    (1985).    The  sorry  state  of  educational 
statistics.    Paper  prepared  for  the  U.S.  Department  of  Education*  January* 

Craln>  Robert*  L.    (1984).    The  quality  of  amerlcan  high  school  graduates: 
What  personnel  officers  say  and  do  about  It*    Center  for  the  Social 
Organization  of  Schools  Report*    Baltimore:    The  Johns  Hopkins  University* 

Epstein*  J.L*    (1984).    Single  parents  and  the  schools:    The  effect  of  marital 
status  on  parent  and  teacher  evaluations  (Report  No.  353).    Baltimore:  The 
Johns  Hopkins  University*  Center  for  Social  Organisation  of  Schools* 

Evertson*  C*  Willis*  D.*  &  Zlotnlk*  M.    (1985).    Making  a  difference  In 

educational  quality  through  teacher  education*   Journal  of  Teacher  Education* 
36  (May  *  June)  forthcoming* 

Green*  J.L.*  &  Harker*  J.O.   (1982).   Gaining  access  to  learning: 

Conversational^  social*  and  cognitive  demands  of  group  participation*    In  L. 
Cherry-Wilkinson  (Ed.).    Communicating  in  the  classroom.    New  York:  Academic 
Press* 


ERIC 


239 

230  • 


Hawley,  W.D.,    (Forthcoming).    False  premises,  false  promises:  The 
mythological  character  of  public  discourse  about  education.    Phi  Delta 
Kappan." 

Hawley,  W.D.,  &  Susan  Rosenholtz    (1984).    "Good  schools:    what  research  says 
about  improving  student  achievement",  Peabody  Journal  of  Education,  61,  entire 
issue. 

MacKenzie,  D.E.    (1983).    Research  for  school  improvement:    An  appraisal  of  some 
recent  trends.    Educational  Researcher,  12  (4),  5-17. 

National  Consortium  on  Educational  Excellence    (1984).    An  Agenda  for  Educational 
Renewal:    A  Fiew  from  the  Firing  Line.    Nashville:    Peabody  College  of  Vanderbilt 
University. 

Northwest  Regional  Educational  Laboratory    (n.d.).    Effective  School  Practices:  A 
Research  Synthesis.    Portland,  Oregon. 

Peters,  T.J.,  &  Waterman,  R.H.,  Jr.    (1982).   In  Search  of  Excellence:  Lessons 
from  America's  Best-run  Companies.    New  York:    Harper  i  Row. 

Purkey,  S.C.,  &  Smith,  M.S.  ..(1983).    Effective  schools— a  review.  Elementary 
School  Journal,  16,  27-29. 


Ravltch,  D.    (1983).    The  Troubled  Crusade.   New  York:    Basil  Books. 

Rnfh    R     &  Mastaln.  R.    (Eds.)    (1984).    Manual  on  certification.  Sacramento: 
SiU?;kl  Asso"  aaV^  Directors  of  Teacher  Education  and 

Certification. 

Samson.  G.E.,  Grave,  M.E.',  Welnsteln,  T.,  &  Walberg,  H.J.    (lf84).  Academic  and 
rccupatW  performance:    A  quantitative  synthesis.    American  Educational 
Research  Journal.  21.  311-322. 

Smith   Marshall  S.    (1984).    Educational  Improvements  Which  Make  A  Difference: 
thoughts  IS^^^^^  National  Report,  About  Education.    Washington.  D.C.: 

Federation  of  Behavioral.  Psychological  and  Cognitive  Sciences. 


ERIC 


240 

231 


QrganizatloDal  Efficacy  as  &  Beaearch 
Fbcus  for  School  Ifqxro^ement 


Richard  H*  Hersh 
Vice  President  for  Academic  Affairs 
University  of  New  Hampshire 
Durham^  New  Hampshire 


241 

232 


( 


ERIC 


For  the  past  six  years  I  have  been  reviewing  the  research 
literature  to  determine  what,  if  anything,  makes  sane  schools  and 
teachers  more  effective  than  others.  Happily,  there  is  emerging 
from  such  research  a  variety  of  clues  which,  when  put  together 
into  a  coherent  ^le,  seems  to  make  a  great  deal  of  intuitive 
sense.  What  is  particularly  pleasing  is  that  different 
researchers,  in  a  variety  of  studies,  are  reaching  similar 
conclusions  about  effective  schooling .  Furthennore ,  these 
conclusions  are  reinforced  by  school  teachers  and  administrators 
who  bring  to  research  programs  the  critical  eyes  of  school 
experience.  This  conjunction  of  researchers'  knowledge  and 
I>rofes8i(Xial  educators'  wisdom  increases  the  face  validity  of  the 
findings  but  is  only  a  beginning  in  understanding  the  casual 
relationships  required  in  understanding  ^rtiat  males  an  effective 
school. 

Three  powerful  facts  have  emerged  •  First ,  people  run 
schools.  How  teachers,  administrators,  and  students  b^ave  in  a 
school  setting  matters  and  counts  heavily  toward  deteimining  a 
school's  effectiveness.  Second,  quality  and  not  just  quantity  of 
effort,  materials,  and  tljne  is  what  counts.  Previously  measured 
factors  such  as  the  total  number  of  books  in  the  school  library, 
dollar  amount  spent  per  child,  and  the  average  number  of  years  of 
teacher    experience    have    been    shown   to   account    for  little 
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difference  between  more  and  less  effective  schools.  Third,  the 
curriculum  of  the  school,  which  includes  both  what  is  taught  and 
how  it  is  taught,  is  important. 

ATIRIBDTES  OP  gPBCTIVB  SCBOOL^ 

Table  1  lists  two  sets  of  attributes  associated  with  most 
effective  schools.  Under  the  heading  of  "Social  Organization"  are 
listed  those  characteristics  which  pervade  the  school  building. 
These  attributes  (Clear  Academic  and  Social  B^avior  Goals;  Order 
and  Discipline;  High  Expectations;  Teacher  Efficacy;  Pervasive 
Carinfi;  Public  Rewards  and  Incentives;  Administrative  Leadership; 
Oonmunity  Support)  help  pranote  school-wide  conditions  for 
teaching  and  learning  across  all  classrooms.  In  essence,  these 
are  necessary  social  conditions  ^ich  help  individual  teachers  and 
students  to  excel. 

The  second  heading,  "Instruction  and  Curriculun,"  subsiines 
those  characteristics  which  are  found  in  the  most  effective 
classrooms.  These  attributes  (High  Academic  Learning  Tiine; 
Frequent  and  Monitored  Homework;  Frequent  Monitoring  of  Student 
Progress;  Tightly  (toupled  (Xirriculum;  Variety  of  Teaching 
Strategies;  Opportunities  for  Student  Responsibility),  in  the 
context  of  the  previously  mentioned  social  organization  factors, 
help  promote  the  classrocm  conditions  for  maximun  student 
engagement  with  purposeful  learning  activities*  Please  note  that 
the  line  between  the  two  sets  of  conditions  ("Social  Organization" 
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and  Instruction  and  Curriculum")  is  not  hard  and  fast.  In  fact, 
the  two  sets  are  overlapping  and  interactive,  conplementary  and 
reciprocal.  Clear  school-wide  goals,  for  example,  may  not  only 
help  generate  ccmmunity  understanding  and  support,  but  also  they 
allow  individual  teachers  to  assess  more  accurately  the  fit 
between  their  expectations  for  students,  students'  expectations  of 
themselves,  and  the  curriculum. 


Table  1 

ATTRIBUTES  OF  EFFECTIVE  SCHOOLS 


Social  Organization 

Clear  Academic  &  Social 
Behavior  Goals 

Order       &  Discipline 

High  Expectations 

Teacher  Efficacy 
Pervasive  Caring 
Public  Rewards  &  Incentives 
Administrative  Leadership 
Cocmunlty  Support 


InstructiOQ  and  Curriculum 

High  Acadenic  Learning 
Time  (ALT) 


Frequent  and  Monitored 
Homework 

Frequent  Monitoring  of  Student 
Progress 

Tightly  Coupled  Curriculun 

Variety  of  Teaching  Strategies 

Opportunities  for  Student 
Responsibility 
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CDMDIATIVB  EFFBCTS  ^ 

Each  of  the  above  attributes  has  been  identified  in  effective 
school  studies.  However,  it  is  important  to  note  that  simply 
developing  one,  two,  or  three  of  these  characteristics  at  randan 
would  not  necessarily  result  in  a  more  effective  school.  The 
important  conclusion  to  be  drawn  fron  the  research  is  that  it  may 
be  the  cimulative  effects  of  these  conditions  that  have  payoff. 
Although  no  one  has  shown  viAiich  ones  or  bow  many  of  the  above 
conditions  are  necessary  and  sufficient  to  gxmrantee  an  effective 
school^  observers  of  effective  schools  si^gest  that  there  is  an 
element  of  synei^.  That  is,  it  seems  many  things  have  to  be  done 
at  once  to  do  one  thing  well.  It  woxild  be  folly,  for  instance,  to 
believe  that  simply  increasing  teacher  expectations  for  students  ^ 
would  necessarily  lead  to  increased  academic  learning  time  or 
teacher  efficacy.  Bat,  in  sane  combination,  sane  quality  and 
quantity  of  these  attributes  reach  a  critical  mass  of  conditions 
which  prcmote  stiident  achievement.  It  is  this  combination^  this 
critical  mass  of  conditions  ^ich  I  label  "organizational 
efficacy"  and  it  is  this  construct  which  I  believe  needs  to  be 
more  thoroughly  developed  and  investigated  by  the  U.S.  Department 
of  Education*  What  I  am  siggesting  is  rather  complex  and  will 
require  a  disposition  more  toward  qualitative  rather  than  a 
quantitative  assessnent  of  schooling.  Which  agency  tackles  this 
issue  (e.g.  The  National  Center  for  Educational  Statistics; 
National  Institute  of  Education;  Fund  for  the  Improvement  of  Post 
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Secondary  Education)  is  a  policy  question  to  be  determined  later. 

School  improvement  efforts  over  the  past  decades,  .often 
referred  to  as  "reform  movements",  have  variously  emphasized; 
Curriculun  content  and  pedagogy,  e.g.,  "new"  science,  math,  and 
social  studies;  Back  to  Basics;  Technology,  e.g.,  television, 
calculators,  and  computers.  We  see  a  combination  of  these  foci 
emerging  in  the  school  effectiveness  literature  and  the  addition 
of  the  more  recent  concern  for  selection,  training  and  retention 
of  teachers.  I  think  the  schooling  effectiveness  research 
provides  a  new  lens  through  which  to  view  the  problem  of 
educational  improvement  and  it  is  in  the  context  of  that 
literature  that  I  believe  the  concept  of  organizational  efficacy 
resides  and  must  be  tapped  if  we  are  to  move  to  a  more  complex 
understanding  of  improving  schools. 

Each  of  the  attributes  above  is  by  itself  worthy  of  serious 
consideration  and  each  has  been  treated  separately  during  the  past 
decades.  But  what  I'm  suggesting  here  is  that  it  is  the 
interaction  of  all  of  these  ingredients,  the  cumulative  effect, 
the  synergy  created  by  the  interactions  that  will  determine  if  a 
school  Improvement  effort  results  in  significant  change  in  student 
learning.  Tto  put  it  in  more  concrete  terms,  I  am  suggesting,  for 
example,  that  we  could  triple  teacher  salaries  tomorrow  (»4iich  we 
might  want  to  do  on  moral  grounds),  yet  no  increase  in  student 
achievement  would  occur.  Or,  if  we  required  teachers  to  have 
Ph.D.'s  in  subject  matter  content  as  a  substitute  for  present 
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certification  r-txiuironents,  and  these  teachers  had  to  face  the 
same  school  conditions  they  face  now,  it  is  doubtful  that  student 
achievement  wuld  increase. 

I  an  talking  about  more  than  the  culture  of  the  school  or  its 
ethos,  although  these  are  important  factors.  I  am  also  talking 
about  a  school's  capacity  to  not  only  change  itself  once  (its 
values,  expectations,  i  ^ards,  use  of  time,  curriculum,  etc.) 
but  to  change  constantly,  as  a  condition  of  organizational 
existence.  A  school  organization  which  is  never  totally  satisfied 
with  itself  will  strive  to  Improve  continiiously  and  will  create  an 
assessment  system  which  allows  its  personnel  to  not  only  monitor 
student  learning  but  also  monitor  the  organization's  own  capacity 
to  change.  An  organization  in  such  a  continuous  improvement  mode 
is  like  a  spinning  top^tbe  gyroscopic  force  o^  uiotion  is  itself  a 
foim  of  stability^  This  dynamic  aspect  of  an  effective  school 
organization  is  what  Bruce  Joyce  and  I  refer  to  as  "homeostasis  of 
change"  in  our  recent  bock  The  Structure  of  School  Improvement. 

Organizational  life  generates  bomeostatic  forces,  that  is, 
forces  that  tend  to  stabilize  patterns  of  behavior  and  keep  them 
within  a  noimative  range.  Hcmeostatic  for.es  are  similar  to  those 
physiological  mechanisms  in  the  himan  organian  which  keep  life 
siT^port  functions  within  a  nomal  range.  In  the  social  domain 
hciswoscatic  farces  resist  attempts  at  change,  precisely  because  it 
is  their  fiuactic    to  prevent  changes  that  might  endanger  some 
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essential  aspect  of  life  in  the  institution.  Learning  to  live 
within  any  organization  generates  homeostatic  pressure and 
schools  are  no  exception*  The  cellular  model  of  the  school  in 
which  inJividiiiil  teachers  hold  sway  over  particular  domains  and 
functions  (the  third  grade,  sophomore  English,  etc.)  has  greatly 
affected  the  school ' s  ' receptiveaess  to  initiatives  for 
Improvement.  Inside  these  cells  there  is  considerable  autonomy. 
Most  teacher :i  work  in  relative  isolation,  with  almost  total 
operational  authority  over  the  domains  to  which  they  have  been 
assigned.  Administrative  coordination  in  most  schools  en5)hasizes 
management  matters  such  as  attendance,  record  keeping, 
transportation  scheduling ,  the  cafeteria ,  and  disciplining 
specific  children,  with  much  less  attention  to  curriculun  and 
instruction.  Teachers  overtly  ccmplain  about  their  isolation  but 
nonetheless  often  struggle  to  maintain  it  because,  within  their 
domain,  roles  are  well  defined  and  outside  there  is  a  very 
unpredictable  milieu.  Thiey  prefer  social  interchange  which  does 
not  directly  challenge  their  functioning. 

In  most  schools  there  is  a  tacit  understanding  between 
administrators  and  teachers  that  their  respective  domains  arc  not 
to  be  encroached  on.  Infoimal  sanctions  are  ^plied  to 
individuals  who  violate  the  noms  of  privacy  in  the  classroon,  or 
attenpt  generate  systematic  change  that  affects  working 
conditions.  Teachers  apply  social  pressure  to  principals  to  avoid 
direct  supervision  and  possible  changes.     Similarly,  principals 
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expect  to  manage  logistics  and  camiunity  relationships  with  a 
minimum  of  collective  decisim  making. 

Horaeostatic  forces  are  brought  into  play  when  "change  agents" 
enter  the  system.  The  chief  horaeostatic  mechanism  is  informal 
social  pressure.  Teachers  in  most  schools  are  not  well  organized 
in  terms  of  fonnal  collective  decision  makirig  but  they  are  very 
well  organized  in  teims  of  generating  negative  social  pressure. 
Fbr  eTwnplep  if  principals  wish  to  visit  their  classroom  and  offer 
clinical  support,  teachers'  primary  mode  of  counterattack  is  vO 
disparage  them  and  suggest  that  they  are  not  competent  to  carry 
out  clinical  functions.  If  a  curriculum  change  is  initiated  by 
central  office  personnel,  resisting  teachers  dianiss  it  as 
"theoretical  nonsense."  University  professors  are  regarded  by 
many  as  "uselessly  abstract"  and  innovators  as  "faddists." 
Disparagement  is  not  reserved  solely  for  outsiders  who  would  bring 
innovation  into  the  scene  but  is  also  directed  toward  other 
teachers  daring  enough  to  innovate.  In  many  schools  the 
innovative  teachers  have  become  social  isolates. 

The  OGmbination  of  autonomy  in  the  classroom,  relative  lack 
of  formal  structures  for  decision  making ,  low  levels  of 
siq)ervislon,  and  the  use  of  informal  social  pressure  to  maintain 
classroom  privacy  and  resist  collective  decision-making,  result  in 
paradoxical  findings  regarding  teachers*  feeling  of  efficacy. 
Surveys  report  that  many  teachers  believe  they  have  great  autonomy 
within  the  classroom  but  are  powerless  with  respect  to  overall 
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district  and  schoolwide  decision  making,  in  most  schools  and 
district  teachers  are  relatively  po\^erful  within  the  classrccm  but 
experience  low  level s  of  involvement  at  other  level s  of  the 
organizr  :ion.  The  isolation  of  the  classroom  increases  teachers* 
power  within  it  while  reducing  their  power  outside  it. 

This  duality  presents  a  serious  problem  because  the  effective 
school  research  suugests  that  school  Improvement  requires 
collective  activity.  Any  attenpt  to  create  a  better  environment 
for  education  will  have  to  decrease  isolation,  increase 
cooperative  planning,  and  sharply  lengthen  the  amount  of  time  in 
meetings.  There  will  be  a  corresponding  lessening  of  the  autonomy 
of  the  classroom  and  an  increase  in  teachers'  efficacy  in 
schoolwide  and  district  planning.  Unless  collective  activity 
becomes  the  nora  homeostatic  forces  reign  and  the  move  toward 
increased  organizational  efficacy  is  stifled.  Because  homeostatic 
forces  are  usually  more  powerful  than  innovative  forces  at  every 
level  of  education,  ad  hoc  structures  have  to  be  created  to 
promote  innovation  and  to  protect  against  booieostatic  forces.  In 
the  absence  of  an  executive  role  that  promotes  innovation,  the 
necessary  conditions  (collective  ownership,  marshaling  of 
resources,  development  of  training,  and  cocnnunity  involvement) 
have  to  be  created  each  time  a  decision  to  innovate  is  made  and 
these  conditions  have  to  be  sustained  if  the  innovation  is  to 
persist. 
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To  eliminate  the  need  for  ad  hoc  executive  and  protective 
authority  calls  for  a  substantial  organizational  change,  one  that 
pemits  reasonable  and  continuous  innovation  to  take  place.  The 
condition  that  must  be  created  is  a  honeostasis  of  change,  a 
condition  in  which  organizational  stability  actually  depends  on 
the  continuous  process  of  school  improvement.  Innovations, 
occasionally  large  but  mainly  snoall  and  practitioner  induced,  need 
to  be  normalized.  To  make  this  fom  of  organizational  efficacy 
happen  is  no  aiall  order  and  there  are  no  "five  easy  steps"  to 
success.  Organizational  efficacy  occurs,  as  I  suggested  above, 
when  a  school  attains  both  a  particular  level  of  ex-'jellence  in 
each  of  the  above  attributes  and  the  ability  to  Improve 
continuously. 

Bern  to  Asaess  School  Otganizatlonal  Efficacy 

Organizational  efficacy  is  obviously  linked  to  specified 
outccmes.  Since  a  school's  purpose  is  multi-facted,  ranging  from 
basic  skills,  to  critical  thinking,  to  citizenship  skills  and 
values,  these  purposes  will  have  to  be  carefully  articulated  and 
criteria  for  assesaoent  specified.  But  that  is  precisely  the 
function  of  the  "clearly  stated  goals  and  purposes"  in  the 
schooling  effectiveness  literature.    And,  we  need  to  continue  to 
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debate  the  issue  of  schooling  priorities  in  a  technological 
society,  but  that  is  not  tlie  purpose  of  this  paper* 

The  quantitative  data  already  being  gathered  by  a  variety  of 
agencies,  including  the  National  Center  for  Education  Statistics, 
is  &  necessary  but  not  sufficient  condition  for  the  assessment  of 
organizational  efficacy •  Miile  standardized  student  achievement 
measiires  across  schools  tend  to  be  minimalist,  they  provide  a 
beginning,  conmon  basis  for  comparison  of  effects  across  schools, 
whose  purposes  and  student  populations  are  avowedly  similar  but 
whose  effects  are  different.  Such  data,  however,  tend  toward 
basic  skills  and  rarely,  if  ever,  tap  the  higher  order  learning 
involving  analytical  thinking,  for  example,  which  we  hear  is 
increasingly  isxxportSLOt  in  a  world  of  ubiquitous  data.  What  we 
need  In  addition,  are  hundreds  of  in-depth  case  studies  such  that 
each  study  can  help  illuminate  the  meaning  of  organizational 
efficacy  for  a  particular  school  and  help  us  generalize  to  that 
level  of  a  critical  mass  of  attributes  needed  under  different 
conditions  to  achieve  specific  purposes  for  any  school* 

The  ways  in  iAiich  the  ''effectiveness^  variables  work  in 
schools  is  not  easily  quantifiable.  Up  to  now  it  has  been 
difficult  to  assess  to  what  degree  administrative  leadership,  for 
example,  accounts  for  a  school's  efficacy  versus,  let's  say,  high 
expectations  or  a  tightly  coupled  curriculum.  Likewise,  there  has 
been  no  way  to  tell  whether  good  instructional  practice  can 
compensate    for    poor    materials    or   good   materials    for  poor 
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instruction.  In  short,  the  relative  importance  of  each  variable 
is  unknown. 

The  search  for  tb**  degree  to  which  each  variable  is 
applicable  and  how  it  contributes  to  effective  schooling  ought  to 
go  on,  I  suggest  that  a  concurrent  research  effort  *ould  concern 
itself  with  the  more  synergistic  impact  of  the  collective  set  of 
effective  school  variables,  a  set  I  am  labeling  organizational 
efficacy.  Such  an  effort  would  require  hundreds  of  case  studies 
rather  than  the  use  of  standardized  tests.  Sfeveral  years  ago 
Tomlinson  pointed  out  that  we  should  take  comfort  frcxn  the 
emerging  evidence: 


It  signifies  a  situation  we  can  alter.  The 
cannon  thread  of  meanlog  of  all  that  research  has 
disclosed  tells  us  that  academically  effective 
schools  are  "merely"  schools  organized  on  behalf 
of  the  consistent  and  undeviating  pursuit  of 
learning.  The  parties  to  the  enterprise- 
principals,  teachers,  parents,  and  by  fait 
accompli ,  student  s-coalesce  on  the  purpose , 
justification  and  methods  of  schooling.  Their 
ccnmon  energies  are  spent  on  teaching  and 
learning  in  a  ^stematic  fashion.  They  are 
serious  about,  even  dedicated  to,  the  proposition 
that  children  can  and  ^lall  learn  in  schools.  No 
special  treatment  and  no  magic,  just  the 
provision  of  the  necessary  conditions  for 
learning. 


Rxnising  on  "just  the  provision  of  the  necessary  conditions 
for  learning"  is  to  focus  on  organizational  efficacy.    To  do  so  we 
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(  will  need  "thick"  descriptions  of  school  reality  which  only  case 

studies  provide. 

An  example  here  may  help.  Several  years  ago  I  visited  the 
hforth  Carolina  High  School  of  Math  and  Science.  There  one  sees  a 
small  residential  public  school  with  all  of  the  effective  school 
attributes  in  place  and  a  selected  group  of  students  with  high 
motivation  and  high  past  achievement.  In  sun,  the  conditions  of 
teaching  and  learning  in  this  school  are  optimal  and  unique  to 
public  schools  -  snail  classes,  fewer  classes  to  teach,  extensive 
teacher  preparation  time,  adult  excitment,  opportunities  to  work 
with  individual  students,  etc.  The  fact  that  this  school  achieves 
well  is  not  surprising  but  it  is  also  not  by  chance.  The 
monetary  and  time  resources,  the  ccnmitment  of  personnel,  and  the 

^  willingness  to  Improve  constantly,   all  combine  to  create  an 

organizational  efficacy  which  can,  I  think,  be  explained  as  a 
contributor  beyond  the  fact  of  having  selected  the  best  students 
in  the  state.  Indeed,  the  students,  who  are  juniors  when  they 
enter,  testify  to  extreme  differences  in  the  comparison  between 
their  old  high  schools  and  this  one,  exclaiming  that  "I  never  knew 
how  much  there  is  worth  learning"  and  "I  never  knew  how  much 
could  learn* 

What  an  assesanent  of  organizational  efficacy  can  do  through 
the  case-study  method  would  be  to  inform  us  of  what  school 
conditions  together  seem  to  explain  significant  and  pervasive 
student    achievcL*;*^,    not    to    mention    student    and  faculty 
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satisfaction.  Nor  should  this  type  of  study  be  limited  to  public 
and  private  K-12  schools  for  a  great  deal  of  schooling  is  now 
being  carried  out  by  private  and  sometijnes  federally  funded  job 
training  centers  whose  organizational  efficacy  too  can  be  made 
more  effective. 
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INTRODUCTION 


liiis  paper  is  about  the  politics  of  educational  data  collection.  It 
will  discuss  the  human  side  of  data  collection,  rather  than  the 
technical  side.  It  will  explore  the  sources  of  resentment  that  can  lead 
state  and  local  education  agencies  to  evade  federal  data  requests  or 
provide  inaccurate  responses. 

My  choice  of  this  topic  was  stimulated  by    "The  Sorry  State  of 
Education  Statistics,"  by  Cooke,  Ginsburg,  and  Smith.    That  paper's 
great  contribution  is  to  cill  attention  to  the  importance  of  deliberate 
misreporting  in  determining  the  quality  of  federal  education  data. 
Technical  improvements,  such  as  those  emphasized  in  NCES'  call  for 
papers,  are  very  important,  but  they  get  at  only  part  of  the  problem. 
The  part  of  the  problem  that  is  not  amer.a^le  to  technical  solution  is 
the  respondent's  interest  in  cooperating  with  the  data  collection 
effort,  and  ensuring  that  his  or  her  answers  are  accurate. 

In  this  paper  I  draw  primarily  on  my  own  experience:  first  as  the 
director  of  a  major  federal  data  collection  effort  (the  NIE  Compensatory 
Education  Study,  1974  •1977);  and  second  as  the  principal  investigator 
on  a  number  of  Rand  studies  about  state  and  local  responses  to  federal 
education  requirements.  In  the  first  role  I  had  to  negotiate  with  state 
and  local  education  to  gain  their  cooperation  with  NIE's  data  collection 
efforts;  in  the  second  I  expressly  set  out  to  understand  the  causes  and 
consequences  of  the  strong  antagonisms  between  federal  and  state 
officials  that  I  had  observed  during  the  NIE  study.    Both  experiences 
convinced  me  that  much  of  the  political  backlash  against  federal 
education  programs  in  the  late  1970s  was  ultimately  founded  in  personal 
and  professional  rivalries  between  regulators  and  the  regulated.  Those 
rivalries  were  inevitable  because  federal  agencies  tried  to  impose 
constraints  in  areas  that  state  and  local  officials  thought  were  their 
own  business* 

Though  I  thought  that  the  polemical  atmosphere  that  prevailed  in 
the  late  1970s  was  harmful,  my  goal  was  not  to  assign  blame  for  It.  The 
atmosphere  was  simply  the  result  of  a  sustained  rivalry  among  federal, 


state,  and  local  administrators.    The  natural  human  tendencies  to  form 
unfavorable  stereotypes  of  rivals  and  to  seek  outside  support  by 
delivering  lurid  accounts  of  rivals'  misdeeds  helped  to  heat  up  the 
conflict.  My  goal  was  to  understand  the  roots  of  the  conflict  so  that 
its  negative  effects  on  educational  politics  and  management  can  be 
controlled. 

In  the  case  of  national  education  data,  it  was  clear  that  the 
conflict  reduced  the  quality,  standardization,  and  timeliness  of  s.ate 
and  local  reporting.    State  and  local  officials  often  understood  the 
goals  of  federal  data  collection  efforts  in  ways  that  might  astoux»d 
federal  officials.    It  was  therefore  inevitable  that  many  would  comply 
minimally  with  requests  and  make  serious  efforts  to  avoid  federal 
impositions  on  their  time  and  independence. 

.  niis  paper  reviews  the  factors  that  lead  state  and  local  agency 
officials  to  resist  federal  data  collection  efforts  or  provide  low- 
quality  responses.    It  then  identifies  some  potential  correctives  - 
federal  government  actions  that  might  make  it  easier  for  states  and 
localities  to  understand  and  cooperate  with  national  data  collection 
programs . 

SOURCES  OF  STATE  AND  LOCAL  RESISTANCE 
Admini strati v«  Burd«n 

This  is  the  most  frequently-cited  cause  of  resistance  and 
resentment  against  f.d.ral  data  collection  .ffort..    It  i.  a  good 
rational,  for  state  and  local  resistance  because  it  i,  easy  for 
official,  to  articulat..  and  it  .akes  perfect  sense  to  members  of  the 
public  who  also  feel  harras.ed  by  federal  reporting  requirements.  But 
burden  is  not  just  a  rallying  cry:  it  is  a  real  problem.  In  the  course 
of  my  Rand  research,  it  became  clear  that  federal  data  requests  are 
.eldom  treated  a.  part  of  the  routine  orga.M=ed  work  of  state  and  local 
agencies.  Except  in  the  largest  and  best-organized  school  districts, 
they  are  additional  loads  that  intrude  on  the  schedules  of  already  fully- 
programmed  staff  members.    State  and  local  agencies  can  organize  their 
work  to  make  federal  requests  seem  less  burdensome,  but  they  have  little 
incentive  to  do  so.      The  onus  of  ameliorating  the  "burden"  problem 
consequently  falls  on  the  sponsors  of  federal  data  collection  efforts. 
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NCES's  recent  efforts  to  reduce  the  number  and  complexity  of 
requests  strike  at  the  heart  of  the  problem.  But  burden  will  remain  an 
issue  as  long  as  state  and  local  administrators  believe  that  federal 
agencies  make  assignments  cavalierly,  without  careful  assessment  of  the 
need  for  data  or  of  states'  and  localities'  real  obligation  to  provide 
it.  That  leads  to  the  second  source  of  resistance. 

Federal  Presumptiousness 

In  strictly  legal  terms,  states  and  LEAs  accepted  the 
responsibility  to  answer  federal  data  requests  when  they  first  took 
federal  grant  funds  in  the  mid-60s.  But  many  of  the  ooligations  were 
imposed  post-hoc,  and  bear  little  obvious  connection  to  the 
administration  and  evaluation  of  today's  grant  programs.  Furthermore, 
many  of  today's  administrators  were  not  around  when  the  orignial 
contract  was  made,  and  either  do  not  know  about  it  or  feel  no  personal 
obligation  to  live  up  to  it.    Thus,  in  today's  context,  the  simple 
assertion  that  the  locals  have  a  legal  obligation  to  provide  data  is  not 
very  effective.    Respondents  need  to  be  convinced  that  the  iata  are 
going  to  be  used  for  a  plausibly  important  purpose,  not  simply  to 
sustain  a  federal  bureaucratic  routine.    Some  possible  ways  to  help  make 
the  purposes  of  federal  data  efforts  are  discussed  below. 

F«ar  of  Harm 

Overt  opposition  is  not  the  only  form  of  resistance  to  federal  data 
requests.  Many  agencies  are  afraid  to  ignore  requests,  bu.:  resist  by 
providing  flawed  or  incomplete  information.    There  are  two  basic  motives 
for  such  resistance:  the  desire  to  avoid  enforcement  actions,  and  the 
wish  to  avoid  embarassment  at  home. 

Avoidint  Enforcement  Actions.    Local  officials  know  that  some 
federal  agencies  gather  data  that  can  trigger  compliance  reviews  or  be 
used  to  frame  lawsuits.  Though  officials  in  the  more  sophisticated 
school  districts  know  the  difference  between  NCES'  (Or  NIE's)  data 
collection  and,  say,  OCR's,  officials  in  smaller  districts  often  do  not. 
To  most  local  administrators  the  federal  education  bureaucracy  is  a  big 
black  box.    Distinctions  that  seem  utterly  clear  in  Washington  -- 
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between  audits  and  sample  surveys »  and  between  OCR  compliance  reviews 
and  exploratory  research       are  not  at  all  clear  to  many  local 
administrators.    In  the  course  of  my  research  for  Rand  it  became  clear 
that  local  officials  would  regard  my  colleagues  and  me  as  potential 
informants  for  federal  enforcement  agencies  until  we  proved  otherwise. 
They  routinely  assumed  that  any  data  collection  effort  was  the  most 
threatening  kind  imaginable. 

Avoiding  Embarassaent .    Local  officials  are  understandably 
reluctant  to  give  NCES  data  that  could  make  them  look  bad.    This  motive 
is  especially  Intense  when  the  data  are  or  could  be  used  in  inter *state 
or  inter*district  comparisons.    But  it  applies  even  when  the  study 
sponsors  have  no  plans  to  identify  the  agencies  from  which  the  data  were 
collected. 

The  more  sophisticated  school  districts  are  not  unwilling  to  make 
public  disclosures,  even  of  sensitive  budgetary  and  student  performance 
data.  They  often  devote  considerable  resources  to  collection,  analysis, 
and  publication  of  Just  such  data.  Given  the  degree  of  public  scrutiny 
such  reports  get,  most  are  very  careful  to  maintain  decent  professional 
standards  of  analysis:  bad  news  gets  reported  carefully,  but  it  gets 
reported.  Such  agencies  are  doubly  reluctant  to  give  raw  data  about 
themselves  to  anyone  else.    Others  may  not  adhere  to  as  high  a 
professional  standard  of  analysis  as  the  district's  own  research  of 
evaluation  division  maintains;  and  whatever  the  quality  of  analysis, 
outsiders  (including  federal  agencies)  are  unlikely  to  be  as  careful  as 
local  officials  about  about  the  timing  phrasing  of  disclosures  about  the 
district's  problems  and  accomplishments. 

The  avoidance  of  inter-district  comparisons  may  be  a  less  important 
motive  now  than  in  the  past.  The  public  and  elected  officials  now  expect 
such  comparisons  to  be  made,  and  are  not  likely  to  support  educational 
administrators*  efforts  to  withold  data.    The  wide  attention  given 
Secretary  Bt.ll*s  interstate  comparison  chart,  the  continuing  strength  of 
the  accountability  movement,  and  vh4  AFT's  and  NEA*s  new  acceptance  of 
testing  and  comparisons  among  teachers  all  reduce  the  legitimacy  of  LEA 
efforts  to  withold  data. 
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HOW  TO  MANAGE  OR  REDUCE  RESISTANCE 

The  following  suggesticns  are  arranged  to  correspond  roughly  with 
the  foregoing  list  of  problems.  But  the  correspondence  is  only  rough:  no 
one  recontroendation  is  a  p«.rfect  solution  to  any  one  of  the  problems.  But 
taken  togetr.er  the  xist  of  recraunended  actions  will,  I  think,  greatly 
reduce  the  severity  of  state  and  local  resistance. 

Reduce  Data  Reporting  Burden  by  Avoiding  Universal  Surveys 

The  premise  of  this  recommendation  is  that  school  districts  will 
resist  federal  data  requests  less  if  they  get  fewer  of  then.  The 
complaints  against  federal  data  burden  could  be  significantly  reduced  by 
a  greater  use  of  sample  surveys.    Although  samples  undoubtedly  produce 
less  precise  estimates  than  population  surveys,  they  are  likely  to 
produce  better  data  in  the  long  run.  If  each  national  survey  involves 
only  a  fraction  of  the  LEAS,  the  number  of  data  requests  to  a  given  LEA 
can  be  reduced.  This  will  particularly  benefit  the  smaller  school 
systems  that  are  the  least  well  equipped  to  supply  data.    They  are 
♦       likely  to  fall  into  sampling  strata  that  have  many  members,  and  will 
therefore  rarely  be  chosen  for  a  study  sample.  Because  larger  districts 
usually  fall  into  sampling  strata  that  have  relatively  few  members,  they 
will  be  chosen  more  frequently  than  smaller  districts.  But  the  larger 
districts  will  still  experience  some  reduction  in  their  response 
burdens . 

Make  Greatap  Usa  of  Contractor*  to  Collect  Data 

My  conflict  of  interest  is  obvious  here,  but  I  will  make  the  point 
because  I  think  it  is  true:  contractors  can  usually  get  better 
respondent  cooperation  than  federal  agencies  can.    The  reasons  are 
simple:  local  educators  can  more  readily  believe  that  professional 
research  firms  are  interested  in  doing  research,  not  compliance  reviews. 
Second,  individual  research  firoi,  can  build  reputations  for  fairness  and 
professionalism  that  put  respondents  at  ease.    That  is  very  difficult 
for  any  government  unit  to  match,  for  reasons  discussed  above:  the 
differences  between  government  agencies  that  do  research  and  those  that 
do  investigations  or  enforcement  are  not  readily  apparent  outside 
metropolitan  Washington. 
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Co„„.ctors  .ay  not  b.  .bl.  to  .„b.titut.  tor  NCES  1„  rt.  conduct 
c   ».„d.tory  .urv.y.  of  .be  .„tir.  ..tion.l  UA  population,  success 
Of  tbos.  studies  probably  r.,uir.s  the  i„pHcit  threat  of  a  tangle  „itb 
he    epart„ent  of  Education  for  non-cooperators.    But  private  firns  .  -e 
y  to  get  far  better  cooperation  -  and  result.  -  for  the  s^ll.; 
sample  surveys  and  exploratory  studies. 

R»port  Study  R.sults  to  th.  Participating  LEAS 

School  systems  will  contribute  .or.  „illi„gi,  „  nces  studie-  if 
they  expect  to  benefit  directly  fro.  the  result..    The  largest  and 
richest  lEAS  run  their  ow,  data  progra...  and  ..,  see  little  need  for 
.Wl..ents  fro.  NCES.    But  the  vast  ..Jorlty  of  school  syst...  could 
use  .ore  data,  particularly  about  student  and  teacher  characteristics, 
th.n  they  ar-  able  to  collect  or  analyze  the.s.lv.s.    NCES  data 
collection  would  be  .or.  velcce  if  locU  officials  knev  that  it  vould 
ult..ately  produce  infor..tion  they  could  use  to  do  their  Job.  better 

particular  value  -ould  be  information  that  U*  official,  could  u..  in 
report,  to  their  own  .chool  boards  and  th.  public.    If  local  officials 
knew  that  NCES  data  collection  lead  to  th.  cr.ation  of  such  r.port. 
th.ir  r.si.t.ac.  to  it  would  .ur.ly  b.  nich  r.duc.d. 

B.C.U..  .an,  dl.trict.  lack  th.  .achin.ry  and  «,.lytical  t.l..t 
necessary  to  u..  r«,  data,  this  .«,g..tio.  la^Ii..  .p.cial  work  on  NCES' 
part,  to  r.port  th.  data  in  for.,  that  school  diatrlcts  th..s.lv.s  want 
to  «...  NCES  .houlu  ,ff.r  patticipatin,  .chool  districts  a  .«,„  of 
possible  reports  that  could  b.  cr.at.d  fro.  th.  data  b.in,  collected. 
n..s,  r.port.  could  b.  siapl.  tabu..tions  and  no.-iaf.r«>tial  .t.tl.tic. 
that  .ight  b.  .uppli.d  With  bri.f  lnt.rpr.tiv.  t.xt..    Pr.paring  such  a 
.enu  would  r.quir.  a  rudimentary  .arket  survey  by  NCES,  to  identify  th. 
range  of  alternative,  that  LE4S  would  find  ua.ful.  It  would  th.n  b. 
.ecssary  for  NCES  to  build  „alytic.l  routinas  to  that  could  produc. 
"y  of  th.  r.port.  automatically.    A  ..all  .p.cial  NCES  staff  would  be 
required,  to  perfor.  quality  control  and  continually  .onitor  th. 
.dequacy  Of  th.  ..nu.  TH.  r.port.  to  U*.  .bould  b.  data-driv„  and  non- 
inferential,  .o  th.r.  .hould  b.  no  need  for  ccplex  t.xtn,riting, 
•diting,  or  clearance. 
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Make  Allies  of  Members  of  Congress 

An  important  way  for  NCES  to  ensure  cooperatiun  from  state  and 
local  education  agencies  is  to  make  allies  of  Members  of  Congress. 
Members  of  Congress  are  naturally  sympathetic  toward  public  agencies  in 
their  constituencies,  and  ready  to  support  them  in  disputes  with  federal 
bureaucracies.    State  and  local  officials  who  ignore  federal  demands 
whether  substantive  rules  like  civil  rights  regulations  or  proct'^ural 
requirements  like  data  requests       can  expect  their  Senators  and 
Representatives  to  help  if  the  going  gets  rough.    This  is  especially 
true  if  the  requirecents  are  based  on  subtle  administrative  rationales 
or  reflect  political  agendas  that  the  Members  of  Congress  do  not 
support • 

The  lack  of  positive  Congressional  support  has  been  a  major  problem 
for  many  educational  data  collection  efforts.    NCES,  the  evaluation 
divisions  of  USOE  and  the  Department,  and  NIE  have  all  run  afoul  of  LEAs 
that  refuse  full  participation  in  studies,  and  either  threaten  or 
actually  do  pull  their  Congressional  representatives  into  the  dispute. 

But  Congressional  support  for  state  and  local  resistance  is  not 
universal  or  automatic.  When  the  political  imperative  behind  a 
requirement  is  obvious  or  when  the  relevft  federal  activity  is  clearly 
useful  and  productive,  Members  of  Congress  are  unlikely  to  support  their 
constituents*  refusal  to  cooperate. 

The  best  way  to  reduce  Congressional  support  for  local  agencies* 
refusal  to  provide  data  is  to  make  the  value  of  the  data  collection 
effort  evident  to  Members  of  Congress.  The  recent  use  of  NCES  data  in 
videly*discussed  national  reports  on  teaching  has  increased  support 
among  Members  of  Congressional  education  committees.    But  to  gain 
support  among  the  majority  of  Members  of  Congress  it  is  necessary  to 
provide  information  that  is  directly  relevant  to  the  individual  Members* 
cons  it  iuenc  ies . 

An  annual  report  on  the  status  of  education  in  each  state  and 
Congressional  district  wuuld  be  a  gu^d  demonstration  of  the  value  of 
NCES*  efforts.    The  reports  should  not  entail  new  data  collection;  the 
financial,  administrative,  and  student  data  that  NCES  now  collects 
should  be  sufficient  for  most  Members*  needs.    The  key  is  to  focus  the 
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reports  directly  on  the  Members'  own  constituencies  and  to  deliver  them 
directly  and  with  some  fanfare  to  the  Members'  offices.    The  desigii  of 
such  reports  can  be  refined  over  time,  as  Members  express  their  interest 
in  specific  information  and  modes  of  reporting.    But  the  most  important 
gain  for  NCES  will  be  registered  quickly,  as  Congressmen,  Senators,  and 
their  staffs  come  to  recognize  that  federal  education  data  collection 
efforts  help  them  understand  their  own  constituencies. 

Negotiate  with  OCR  to  Reduce  Their  Data  Demands 

OCR's  school  district  surveys  are  a  real  problem  for  NCES.  School 
systems  properly  count  the  OCR  surveys  as  part  of  the  overall  federal 
data  burden;  and  their  fear  that  data  requests  can  lead  to  enforcement 
actions  is  largely  based  on  OCR's  use  of  survey  results.  In  these  ways, 
the  OCR  data  program  handicaps  NCES  studies.    Host  of  these  negative 
effects  could  be  avoided.  OCR  could  conduct  sample  surveys,  imposing 
data  burdens  on  only  a  small  fraction  of  LEAS,  without  hurting  the 
quality  of  its  data  or  reducing  itss  ability  to  target  for  compliance 
reviews:  even  a  small  sample  could  identify  more  places  with  suspect 
patterns  than  OCR  could  ever  investigate. 

Seek  Advice  From  CSSOs  Individually.  Not  in  Groups 

Few  researchers  have  difficulty  gaining  the  Chief  State  School 
Officer's  approval  for  data  collection  in  a  particular  state.  As 
individuals,  Chiefs  generally  have  a  broad  policy  perspective  and  are 
eager  to  cooperate  in  studies  that  might  illuminate  important  national 
issues.    Their  cooperation  is  not  automatic       they  n^^ed  a  good 
explanation  of  the  study's  importance       but  they  usually  answer  a 
request  quickly,  without  invoking  complicated  procedures. 

Dealing  with  Chiefs  in  groups  or  through  organizations  can  be  a 
very  different  story.  When  a  data  collector  seeks  clearance  from  a  group 
he  or  she  confronts  the  tendency  for  the  entire  group  to  support 
individual  members'  objections.  Each  member  may  have  one  or  two 
objections  that  could  be  readily  resolved  in  direct  negotiations.  But 
if  the  group  aggregates  individual  members'  objections,  its  collective 
judgment  may  be  that  the  study's  problems  are  insuperable. 
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"Clearance"  groups  have  a  particularly  fierce  d>Tiamic:  they  must 
pass  a  negative  judgment  every  now  and  then  to  maintain  morale  and  prove 
to  constituents  that  they  are  doing  a  job.    This  applies  to  federal 
forms  clearance  organizations  as  well  as  to  external  groups  representing 
SEAs  or  LEAs.  In  dealing  with  such  groups  I  am  frequently  reminded  of  an 
instruction  that  Franklin  D.  Roosevelt  reportedly  gave  to  his  staff: 
"Find  oe  a  bill  to  veto:  I  want  Congress  to  know  that  I'm  still  here." 

The  most  difficult  forum  for  the  clearance  of  education  research 
plans  is  an  advisory  group  composed  of  mid-level  representatives  of  SEAs 
or  LEAs-    The  indivudual  members  of  such  groups  are  serious  and 
competent,  but  they  have  little  to  gain  and  something  to  lose  from 
approving  a  data  collection  request.  No  one  will  ever  thank  them  for 
clearing  a  study  that  later  proved  to  be  very  valuable;  LEA  officials 
are  likely  to  complain  about  the  data  burdens  imposed  by  a  study, 
whatever  its  ultimate  value. 

As  individuals,  the  Chief  State  School  Officers  are  best  equipped 
to  weight  the  likely  burdens  of  a  study  against  its  ultimate  payoff. 
They  can  and  will  complain  about  undue  burdens  and  will  require  data 
collectors  to  accommodate  the  needs  of  local  administrators.  But  they 
also  can  and  will  support  a  study  that  is  needed  and  well  designed. 

CONCLUSION 

The  foregoing  suggestions  are  not  guaranteed  to  eliminate  state  and 
local  resistance  to  NCES  data  collection.  But  they  should  certainly 
reduce  it.  There  is,  however,  a  cost.  To  reduce  resistance  NCES  must 
invest  the  staff  time  and  other  resources  necessary  to  design  more 
parsimonious  sample  surveys,  assess  the  needs  of  LEA  officials  and 
Members  of  Congress,  negotiate  with  other  federal  agencies,  and  deal 
with  important  stakeholders  like  the  Chiefs  individually,  rather  than  in 
groups.    These  are  major  costs  to  pay.    NCES  professionals  would 
probably  prefer  to  spend  their  time  improving  data  definitions  and 
analysis  routines.    But  politics  is  time-consuming,  and  state  and  local 
resistance  is  a  political  problem,  not  a  technical  one. 
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INFORMATION  PGR  EXCELLENCE  AND  EtUITY  IN  EDUCATION 
Asa  G.  Hilliara  m 

Ihe  National  Center  tor  Educational  Statistics  (NCES)  has  served  a  vital 
function  for  eaucators  and  planners,   ihis  has  been  true  in  spite  of  the 
linatations  that  nar  present  oata  gathering  efforts.   Cooke,  Ginsburg  ana 
smith  (1965)  have  written  in  some  detail  about  what  they  refer  to  as  the 
•sorry  state  ot  Educational  SUtistics.-  ihe  state  of  educational  sutistics 
is  most  likely  a  reflection  of  certain  historical  policy  orientations  ncre 
than  any  deiiciancy  of  a  technica.*  oraer. 

Americans  have  had  a  long  and  continuing  struggle  over  the  place  of  public 
eaucation  in  the  nation.    (Hilliard,  1984)   Should  free  eaucation  be  proviaed 
to  all  citizens  from  kindergarten  through  twelfth  grade?  is  there  a  National 
role  in  eaucation  ana,  if  so,  what  is  it?  We  have  lived  with  a  system  where 
the  ideologi-      local  control  of  «Sucation  has  been  predaninant.  Initially, 
both  state  and  national  involvement  were  viewed  with  reservation.   An  yet 
there  has  been  a  steaqy  arift  toward  nore  and  more  centralization  of  support 
tor  ana  centralization  of  control  of  eaucation  at  the  state  and  national 
levels.   An  so  we  fimj  ourselves  with  a  historical  tradition  of  local  autor.omy 
and  with  a  growing  central  tendency  toward  centralization  of  support  and 
control,   ihis  affects  our  new  oata  collection  needs. 

State  ana  national  level  policymakers  and  leaders  neea  to  have  information 
in  oraer  to  exercise  their  functions,   iher.fore,  it  is  necessary  to  continue 
to  aojust  the  data  gathering  system  so  as  to  produce  appropriate  information. 
Ihat  information  must  be  accurate,  reliable,  coniprehensive,  timely, 
representative,  meaningful,  ana  useful. 
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Recently,  a  chart  was  publishea  toy  Secretary  of  Eaucaticn  Iterrence  Bell. 
It  conparea  states  on  various  dimensions.    Ihe  chart  triggered  one  of  the  most 
vigorous  reactions  to  oate  by  educators  and  non-educators  alike. 

secret vy  Bell's  chart  has  acconplished  one  thing,  if  nothing  else,    in  an 
effort  to  defend  themselves  and  to  explain  lower  than  expected  state  rankings, 
sots  Chief  State  School  Officers  ano  others  who  are  synpathetic  to  their 
plight  have  been  forced  to  articulate  and  to  publicize  critiques  of  the  system 
which  might  otherwise  have  been  beard  only  by  a  few.   Certainly,  the  level  of 
oebate  on  these  matters  l.'\s  been  escalated  and  that  is  good.    The  problem 
reirains,  however,  how  oo  we  take  the  opportunity  presented  by  such  escalations 
in  the  level  of  debate  to  improve  our  practices  for  the  benefit  of  the 
chiiaren. 

As  has  already  happened  on  at  least  a  few  occasions,  chief  state  school 
of/icers  have  taken  the  initiative  to  dari^  and  to  standardize  seme  ^ 
practices  where  possible  and  appropriate.    In  the  absence  of  such  successful 
collaboration,  the  effort  to  develop  valid,  reliable,  and  useful  infomation 
tor  national  and  local  policy  planning  will  be  a  waste. 

It  is  time  that  we  accepted,  once  and  for  all,  the  fact  that  education  of 
children  in  the  nation  is  a  public  matter,  just  as  is  the  health  of  the 
nation.   Miether  the  health  services  are  publicly  supported  or  privately 
supported,  we  recognize  a  clear  public  interest  that  requires  public 
oversight.    Education  is  no  less  a  priority.   Whether  education  is  supported 
publicly  or  privately,  the  education  of  all  children  is  in  the  interest  of 
state  and  national  government  levels  ano  to  the  public  at  large.  This 
justifies  major  efforts  such  as  the  current  effort  to  develop  longitudinal  and 
cross-sectional  oata  for  planning  and  evaluation  purposes. 
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I  see  no  serious  problem  with  current  oata  gathering  categories  at  the 
NCLS.    What  is  neeoeo  is  more  refineinent  and  expansion  of  existing  data 
gathering  services.    I  will  attempt  to  address  this  latter  point.    It  is  the 
rerini^nent  ano  exp^ion  ot  the  focus  and  scope  of  present  series  that  will 
improve  the  technical  quality  and  utility  of  NCES  data  programs. 

I  have  chosen  to  group  my  responses  ana  reconmenaations  into  two  general 
but  overlapping  categories,  excellence  and  equity.    In  general,  those  data 
that  su^rt  our  ability  to  move  toward  excellence  are  also  data  that  support 
our  move  toward  equity.   Ohe  reverse  is  also  true. 

I  believe  that  we  want  a  sytem  of  education  that  serves  all  chilcren 
well.   To  ceach  that  goal,  we  neeo  a  clear  picture  of  what  is  going  on  in  the 
schools. 

aearly,  the  eftorts  of  the  National  Center  for  Educational  Statistics  is 
a  macro  effort.    It  can  serve  some  needs.   Other  efforts,  research,  and  site 
visits,  tor  example,  are  requireo  to  round  out  the  picture.   The  efforts  of 
the  NCES  should  be  evaluated  against  our  requirenent  fc:  general  Information. 
fauaiitv  of  Eaucational  Opportunity 

M)ile  it  is  unlikely  that  general  inequity  in  society  can  be  eliminated  or 
reducec  significantly  by  the  activities  of  educators  alone,  at  the  very  least, 
educators  must  struggle  to  eliininate  inequities  in  educational  c^rtunity. 
Ihis  requires  that  areas  of  inequity  or  potential  inequity  in  schools  be 
illuminated  ano  examinea  on  a  regular  basis. 

Iraoitional  areas  where  inequities  appear  to  occur  in  school  settings 
incluoe  such  things  as  differential  drop-out  rates  among  groups  of  students; 
high  transient  rates  among  teachers  and  students;  differentials  in  the 
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OlStriDution  ot  teachers  in  assignments  by  teacher  preparation  ana  experience; 
QXfferentials  m  expenaitures  per  child,  etc.    There  is  a  general  absence  of 
infornation  aixxjt  the  wioe  range  of  diversity  in  the  treatment  of  children. 
Iheretore,  when  academic  achievement  results  are  very  Iw  fc*  some  groups  of 
children,  scoe  educators  have  failed  to  examine  variation  within  the  system  of 
treatment  itself  in  oroer  to  pinpoint  inequity.    Instead,  they  have  engaged  ir 
what  Ysseldyke  and  others  (1982)  called  *a  search  for  pathology*  in  the 
children  as  inoxviouals,  or  even  within  ethnic  or  cultural  groups  of 
children.   A  National  Acaoemy  of  Sciences  Panel  (Heller,  Holtzman,  and 
fjessick,  lif62}  has  suggested  a  different  strategy.   M)en  children  fail  to 
perform,  there  should  be,  at  first,  an  attempt  to  rule  out  the  effects  of  what 
could  oe  a  law  quality  of  educatiofial  treatment. 

,    Naturally,  no  gross  national  data  gathering  effort  can  provide  diagnostic 
ipformation  for  an  inoi^vioual  diild  or  school  site  in  order  to  design  remedial 
wprk.   On  the  other  hand,  at  a  macro  level,  it  may  be  possible  to  spot 
situations  that  call  for  closer  examination.    For  example,  if  it  is  shown  that 
teachers  who  have  the  greatest  amount  of  acaoemic  work  in  mathematics  at  the 
college  level  are  not  likely  to  be  assigned  to  work  in  low  income,  poverty 
areas^this  would  be  a  situation  that  viould  signal  the  need  for  closer 
scrutiny. 

A  refinement  in  data  collection  indices  may  provide  the  possibility  for 
isolating  more  accurately  the  effects  of  educational  treatment  on  students  as 
contrasted  with  the  effects  of  certain  non*school  factors.    In  oroer  to  be  in 
a  position  to  aooress  policy  issues  from  an  equity  perspective  more  appro* 
priateiy,  the  following  types  of  oata  should  be  collected. 
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juate  puDlic  school  «na  prlvar^  a,ta  coli..H.n    lo  the  extent 

po^iWe,  the        tipes  of  dat.  shoula  be  eollectea  for  Doth  public  «a 
private  schools.   At  present,  «,ch  of  the  public  school  data  at.  census  data 
Whereas  .ittually  all  of  the  private  school  dau  are  sa»ple  data.   Given  f 
wioe  oiversity  of  types  and  quality  among  private  schools.,  there  is  sone 
question  resaroinq  the  extent  to  which  small  sa.pie  of  these  private  schools 
can  te  considered  to  be  nationally  represenutive.   For  example,  sane  private 
schools  iMintain  very  hiqh  quality  ^sterns  pre-K  throuqh  IJth  qrade.  Ihey 
.«9in  with  What  some  have  described  as  -college  preparatory  Kindergartens'  for 
a  stuoent  population  that  remains  relatively  stable  as  well  as  homogeneous, 
ethnically,  ana  economically,  throughout  the  full  elementary  ana  secondary 
«nooi  perioo.   other  private  schools  are  hardly  selective  at  all.   ihey  may 
•iso  Offer  a  i«,ch  poorer  quality  of  instr  ction.   ttere  is  a  need  to  be  able 
to  ia«,tify  «.d.  wio.  variation,  in  treatment  m«g  private  schools.  Qearly, 
chUdren  vary  in  t.r»  of  the  quality  of  .ducati«al  experience,  to  which  they 
have  been  exposed.  By  collecting  more  cablet,  n...  ir^  p...^,- 
more  extensive  analy.«i  will  b«aa,  possible.   It  i.       a  matter  of 
collecting  different  data  «>  »uch  as  a  more  intensive  data  coUection  .ff„,> 
expandea  among  private  schools. 

SscenUy,  nich  «io  ha.  been  m«ie  over  th.  relative  quality  of  achievement 
for  public  .chool  student,  u  ccparwi  to  private  school  students.   Yet,  few 
oata  exist  that  help  de«ribe  the  types  of  treatm«6  offereo  to  student,  in 
tn«  two  typ«,  of  «l»ol..  *,  .  r-ult.  K»e  analysu  have  suggest*!  that  low 
capacity  stuoent.  atteng  public  wawol.. 

*eciiic  Hecooinenaation:  As  much  a.  po..ibl«,  collect  the  same  data 

from  private  schools  as  froo  public  t  -Jiools. 
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B.    Level  ana  type  of  non-school  support,    Iteny  children  in  the  nation  are 
prxvilegeo  to  have  special  types  of  support  for  their  academic  groii^  from 
nonschool  sources.    These  things  are  seldom  taken  into  account  in  the 
evaluation  ot  strengths  and  weaknesses  in  schools,  especially  the  public 
schools.   They  are  seldom  taken  into  account  in  the  evaluation  of  student 
ettorts.   Yet,  any  appropriate  interpretation  or  statistics  that  are  collected 
shoula  be  baseo  upon  the  most  accurate  information  possible.    It  is  especially 
irtix>rtdnt  to  know  the  actual  starting  point  for  individuals  and  groups  in  the 
schools.    For  exairple,  many  parents  are  able  to  {^ovide  paid  tutorials  to 
supplcdiient  the  public  or  private  school  eaucation  of  their  children.  The 
proportion  ot  students  who  receive  such  assistance  may  be  very  high  in  some 
schools  ano  nay  be  nonexistent  in  others.    Such  inequities  in  non-school 
support  cause  confounding  when  interpretations  are  attenpted  using  data  on 
school  effects.   Here  is  another  exanple.   Many  educators  are  becoming  aware 
of  the  rapioly  growing  gap  between  students  who  have  access  to  oonputers  at 
home  and  those  who  do  not.   Such  gaps  may  also  occur  between  schools  that 
serve  poor  children  ano  those  that  serve  the  affluent.   One  would  expect  the 
effects  of  the  gap  to  be  manifest  in  such  areas  as  conputer  literacy,  in 
academic  achievement  (when  coiqputers  are  used  as  instructional  aids),  and  in 
access  to  wora  processing  capabilities  for  conposition  and  paper  writing.  It 
is  unportant  to  know  the  extent  to  which  the  use  of  school -related  techno- 
logies results  in  advantages  or  disadvantages  for  students  who  oo  not  have 
access  to  them.   Accordingly,  it  is  iJ!(X)rtant  that  the  National  C^ter  for 
Eoucational  Statistics  collect  data  on  non-school  support  for  academic 
instruction  such  aj  paid  tutorials  and  data  processing. 
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specific  Reconroenaation:   Collect  data  on  access  to  data  processing 

equipment  for  conputing,  word  processing, 
and  instructional  software,    collect  data 
on  ajnount  and  type  of  paid  or  unpaid  after 
school  tutorial  or  enrichment  services, 

^'   Stability  of  teacher  and  pupil  populations.   Variation  occurs  in  the 

moDility  of  teachers  ano  pupils  at  given  school  sites,    I  visitea  a  school 

recently  where  stuaents  in  a  sixth  grade  class  were  working  with  the  fourth 

matn  teacher  for  the  year,  even  though  the  school  year  was  only  about  one  half 

oonpletea.    in  some  schools  there  are  unusually  large  nunters  of  migrant  or 

transient  children.   The  meaning  of  other  data  such  as  achievement  test  scores 

is  affected  by  such  mobility.    As  a  result,  it  is  inportant  for  the  National 

Center  to  collect  such  data  as  can  give  a  fair  indication  of  the  level  of 

mobility  among  teachers  and  students. 

Specific  Reconmenaation:   Develop  indices  of  mobility  for  teachers, 

students,  and  line  site  administrators, 
Oollect  data  on  nobility  regularly  as  a 
part  of  the  census  or  sanpling  effort, 

D.   Access  to  pre-school.   ohe  general  weight  of  professional  opinion  is  that 

pre-school  is  highly  beneficial  for  children,  at  least  in  terms  of  preparation 

for  acaoemic  success  in  school,   ihe  High  Scope  Foundation's  longitudinal 

<  >      the  effects  of  two  years  of  Head  start  helped  to  extend  our 

concept  of  the  benefits  of  pre-echool  education  to  the  Area  of  social 

corrpetence.    In  other  words,  not  only  die  the  High  Scope  Ptoundation  study  find 

that  later  public  school  academic  achievement  was  higher  among  children  from 

Heaa  Start  Programs  than  from  non-Head  Start  children  but  that  their  social 

adjustment  was  better,   Ano  among  Head  Start  children  who  were  observed  after 

the  point  of  high  school  graduation,  the  acaoemic  achievement  of  pre-schoolers 

was  higher  than  fron  non-Head  start  stuaents.   More  Heao  start  children  were 
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.am-.t«  to  collese,  £e«r  wet.  u.  ttoofl.  with  the  police,  fewer  were 
u,volveo  in  e.tly  pregnancies,  ana  so  forth.   »..t  is  UTfortant  xs  that  in 
spite  of  the  near  universal  agreenent  «ion9  educators  about  the  benefits  of 
quality  early  eoucation  for  pre-sch«l  for  chiloren,  there  are  large  nu*ers 
of  Children  in  .»ria  who  receive  no  pre-school  at  all!   Estinates  shew  that 
only  between  one-tcurth  ana  one,f  ifth  of  the  children  who  are  eligible  for 
Head  Start  are  actually  funded  in  the  program.   Moreover,  there  i.  wide 
variation  in  quality  .»»9  private  |«e-.chool  offerings,  even  for  those 
children  who  are  able  to  afford  pre-chool  on  their  own.   An  appropriate 
as.«ss»ent  of  el««ntary  ano  seco^iary  education  re<^ir.s  that  data  be  kept  on 
the  participation  of  the  attendees  in  pre-school  program  and,  to  the  e,t«.t 
poisible,  oata  shoulo  be  Kept  to  show  the  a«»unt  and  quality  of  pre-*chool 
received. 

<  I  an  reainoed  of  an  e:^ieno.  that  I  bad  recently  where  five  out  of 
twfclve  kindergartens  in  a  ceruin  city  were  designated  as  -develoj^ental 
kAoergartens.-  »s  I  spoke  with  educators  in  that  school  district.  It  was 
Clear  that,  in  their  «ind.,  there  was  almost  a  one-to-one  correspondence 
between  the  designation  -oevelot^ental'  and  the  designation-  retarded.-  Here 
«.  a  case  where  chUoren  were  being  Bade  to  pay  the  price  for  the  lack  of 
pien^hool.   Obey  were  seen  as  retarded  because  of  lo-  «l.ieve«nt,  ev«. 
tliou*  they  had  not  been  given  the  sa«  opfortunity  for  early  education  that 
others  bad.   Yet,  there  was  »  .tte.pt  on  the  i«t  of  school  official,  to 
account  for  the  presence  or  absence  of  pre-«i«ol  experience  before 
designating  children  as  retarded. 

the  ■n.cro  level,  «.  analysis  of  achievement  pattern,  in  the  pri»ry  and 
u»er  ele^tary  grade,  could  well  be  infor«d  by  data  on  the  distrii«tion  of 
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pre-sc4ool  experiences  anong  stuaents.    There  are  ma^or  public  policy 

ui()Iications  here. 

Specitic  Reconvnenaation:   At  least  for  the  elementary  school  years, 

collect  and  report  data  on  the  amount  and 
type  of  pre-school  experience  to  which 
students  have  been  exposed. 

E.    Patterns  of  special  eoucation  placement  and  patterns  of  mobility  among 

programs  by  stuoents.   Anyone  who  is  familiar  with  the  picture  in  special  ' 

eoucation  over  the  past  twenty  years  would  have  to  be  concerned  at  the 

shifting  definitions  and  the  variation  in  labeling  practices  caused  by  such 

oefmitions  as  populations  in  special  need.    For  exanple,  there  has  been  an 

alarming  growth  nationally  in  the  number  of  learning  disabled  children, 

apparently  as  a  result  of  successful  litigation  challenging  the  validity  of 

assessment  of  children  in  the  classes  for  the  educable  mentally  retarded. 

Yet,  stuQies  such  as  those  tyy  Ysseldyke  and  others  (1982)  and  Glass  (1983) 

show  that  there  is  reason  to  question  the  validity  of  the  categories  as  well 

as  the  validity  of  treatments  in  special  education.   In  order  to  be  able  to 

understand  this  picture  more  clearly,  certain  types  data  are  needed.  Among 

them  are  the  following:   10  what  extent  are  there  'graduates*  of  special 

education  programs?   Is  special  education  assignment  really  a  one-way  street, 

or  are  stuoents  beginning  to  be  returned  to  regular  classrooms  after  short 

interventions?  Are  they  being  served  in  regular  classes  through  augmented 

instruction?  Patterns  of  service  in  special  education  are  beginning  to  become 

quite  diverse. 

St>ecif  ic  Recomnendation:   Collect  and  report  data  on  the  mobility  of 

students  in  and  out  of  special  education, 
by  category  of  service,  over  time. 


274 

265 


F.  International  conparisons>    International  comparisons  may  be  helpful  xn 

interpreting  what  v«  are  oomg  In  eaucation  and  in  setting  the  appropriate 

expectations  for  what  can  be  acconplishea  in  eaucation.    Often/      is  easy  to 

oecome  lost  in  our  own  parochi  U  environment  anc  to  see  as  natural  things  that 

are  quite  unique.    For  exanple,  some  of  our  international  competitors  appear 

not  to  have  special  eaucation  as  we  Icnow  it.    Ihey  do  not  have  such  high 

numoers  of  chilaren  designated  into  such  categories  as  educable  mentally 

retaroeo  ana  learning  disablea.   Some  are  able  to  provide  education  v4)ere  the 

overwhelming  majority  of  their  students  are  ab^e  to  achieve  a  high  level  of 

"oasic  skills.*   Ineir  achieven^nt  floors  are  dose  to  our  achievement 

ceiling,    lo  the  extent  that  these  conparisons  are  valid#  they  force  us  to 

raise  serious  questions  about  our  estimates  of  what  the  general  populatl^^ 

students  in  our  own  nation  are  capable  of  achieving. 

^>ecif ic  RecooDendation:   Collect  and  report  data  of  ttte  performance 
,  of  our  students  on  internaticial  tcssts  of 

achiev&nent.   Of  special  interest  should  be 
^  a  conparison  with  the  perfonrence  of 

students  in  industrialized  nations. 

> 

G.  collecting  race  by  sex  informaticn.   During  a  recent  stuoiy  by  the  National 
Acacieany  of  Sciences  (Beller,  Boltznan,  and  Messick,  1982),  it  was  discovered 
that  it  was  not  possible  using  available  educational  statistics  to  do  analyses 
in  oroer  to  determine  certain  types  of  disproportionate  placement  for  children 
in  classes  foe  the  mentally  retaroed.    it  was  possible  to  determine  if  there 
was  ai  proportion  when  conparing  blacks  and  whites.    It  was  also  possible  to 
determine  it  there  was  disproportion  vrtien  conparing  males  and  females, 
hcvever,  as  an  artifact  of  the  way  that  data  were  requested  and  recorded  ,  it 
was  not  possible  to  determine  what  was  happening  by  race  and  sex  at  the  .same 
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time.   So,  for  exanple,  the  frequently  reported  extreme  aisproportionate 
placenent  of  olack  males  in  classes  for  the  mentally  retarded  when  con.rastea 
with  other  categories,  could  not  be  expressed  through  currently  available 
statistics.   A  reconmendation  was  nade  by  the  study  panel  to  the  Office  of 
Civil  Rights  that  oata  be  collected  in  a  way  that  would  permit  race  by  sex 
analysis,   ihere  are  other  areas  in  school  experience  where  it  will  be 
important  to  be  able  to  analyze  data  by  race  and  sex.    For  example,  there  is 
avery  inaication  that  the  statistics  in  discipline  ma^  be  like  those  in 
special  education  placement. 

Drop-out  rates,  disciplinary  actions,  student  achievement,  special 
eaucation  placements,  etc.  should  be  reported  in  such  a  way  as  to  enable 
analyses  to  be  made  both  by  race  and  sex  simultaneously. 

^jecific  Reconmeiidation:   Collect  and  report  all  student  data  so  as 

to  permit  race  by  sex  analyses  to  be 
performed. 

H.   Uvels  of  Aggregation.   A  general  problem  vith  many  and,  perhaps  most, 
statistics  is  that  that  the  results  are  aggregated  at  a  level  that  is  far  too 
high  to  permit  the  best  analysis  of  what  is  going  on.   Data  aggregated  at  the 
state  or  school  district  level  may  serve  some  useful  purposes  but,  for  many 
purposes,  the  most  significant  information  is  the  presence  or  absence  of  a 
pattern  of  variation  among  school  sites  or  even  among  school  classrooms, 
sometimes  within  a  given  school  site.   Uien,  of  course,  as  has  already  been 
recognizea  by  National  Center  sUff ,  there  are  tiroes  when  the  variation  among 
in  J.viauals  is  of  great  interest.   Given  the  capacity  of  data  processing 
equipment  to  handle  large  amounts  of  data,  it  is  iirportant  that  data  on  most 
i;hool  variables  be  disaggregaceo  to  the  lowest  possible  level.    Fot  exanple. 
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xt  was  not  until  the  effective  school  research  movement  that  many  instances  of 

excellence  in  eaiication  at  regular  school  sites  anong  low  income  schools  were 

uncovered.    For  the  most  part,  isolated  schools  that  were  •swimning  upstream" 

were  buriea  in  aggregated  data  which  tended  to  suggest  that  no  such  schools 

existed.    In  fact,  analyses  of  much  of  the  school  effectiveness  research  led 

to  the  erroneous  conclusion  that  schools  had  little  or  no  effect,  ftjestions 

such  as  'Do  schools  work?'  were  conroon.    It  is  notable  that  follwing  the 

effective  school  research,  the  question  more  often  is  'Bcm  oo  gooa  schools 

work?'   Die  same  may  be  said  of  effective  teacher  research. 

specific  Reconnendation:   Wiereever  possible,  disaggregate  data. 

Provide  reports  on  both  aggregated  as  as 
disaggregated  data. 

Educational  Quality 

■    During  recent  year-,  there  has  been  an  extension  of  the  research  on 
effective  teaching  and  effective  schools.   Many  of  the  research  results  have 
riot  been  popularized.   A  few  such  ideas  as  •time-on-task,'  'engaged-learning- 
time,'  •locus-of -control, •  etc.  are  part  of  the  oomnon  professional  language. 
Yet,  many  of  the  things  that  have  been  learned  from  effective  teaching  and 
effective  school*  research  cannot  be  used  in  state  and  national  policy  level 
discourses.   The  oata  that  might  suggest  the  need  for  further  inquiry  are  not 
collected  because  of  feasibility  oonsioeratiaw.   In  some  cases,  it  would  be 
rfearly  iJipossible  to  collect  (on  a  mass  basis)  the  kind  of  information  that  is 
^irable,  sucii  as  time-on-task  by  an  individual  student.    However,  there  are 
other  cases  where  the  collection  of  certain  data  is  feasible  ?.nd  can  illumi- 
nate better  the  quality  of  the  instructional  offerings  in  the  school.  Every 
ofportunity  should  be  taken  to  collect  this  information.   A  few  exanples 
follow. 
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^'    ^-^^  acacemic  preparation  of  t^^rh.r.  National  Center  is  alr-^acy 

sensitive  to  the  problem  of  collecting  information  about  teacher  preparation 

by  relying  upon  certification  categories.    Qearly,  there  is  a  lack  of  unity 

among  the  certification  categories  from  state  to  state.    Bie  same  may  be  said 

for  acaaemic  majors  ana  minors.   However,  it  may  well  be  that  information 

about  the  acaoemic  majors  and  minors  of  teachers  would  be  more  revealing  than 

information  about  the  t>pical  certification  categories  into  which  teachers 

fall.    Ihis  information  should  be  collectecJ.    The  need  for  such  information 

should  be  apparent,   asiere  may  be  equity  <5«.estion»  involved  in  the  assignment 

Of  teachers  according  to  academic  preparation.    For  instance,  let  us  consider 

the  areas  of  mathematics  and  science,   in  a  large  city  school  district  that 

ooes  have  a  full  quota  of  certified  mathematics  teachers  or  science  teachers, 

IS  there  any  relationship  between  the  amount  of  academic  preparation  in 

^       TOthematics  and  the  assignment  of  teachers  to  low  income  and  high  income 

schools.    It  woula  be  of  interest  also  to  know  how  the  public  schools  corpared 

With  private  schools  in  this  regard.   It:  is  well  known  that  some  private 

schools  emphasize  academic  preparation  over  professional  preparation, 

preferring  to  hire  teachers  with  acaaemic  majors  and  with  academic  master's 

aegrees.   Of  course,  this  is  an  area  where  there  are  many,  many  questions. 

Wiat  is  iJiportant  is  that  data  be  available  wh*ch  would  be  useful  in 

developing  answers  to  some  of  those  quef.tions.   Ihe  ease  of  collection  of  such 

:;n£ormation  and  the  availability  of  national  populations  for  study  make  it 

conpel^ing  to  do  so,  considering  the  benefits  which  may  be  obUined. 

^ific  Reconii«naation:   Collect  and  report  data  on  the  acaaemic 

major  and  minor  preparation  of  certified 
staff,  disaggregated  to  the  school  site 
level. 


ERIC 


278 

269 


b.    DescriDing  the  school  curriculum.    Anyone  who  is  even  minimally  familiar 
witn  schools  IS  aware  that  there  is  no  coirmon  nomenclature  for  classes  that 
w-yjla  enable  a  meaningful  analysis  to  take  place  regaraing  precisely  what 
conter.t  is  offered  in  schools.    It  may  well  be  tha   we  are  destined  to  be 
stuck  with  this  problem  in  sooie  form  for  quite  some  time.   Nevertheless,  it 
snoula  be  possible  to  iirprove  upon  present  practices.   A  report  such  as  that 
issueo  by  Die  College  Board  (1984),  Academic  Preparation  for  College;  Wiat 
students  Neeo  to  Know  and  Be  Able  to  Do,  should  be  helpful  in  attenrting  to 
pinpoint  the  types  of  topics  that  may  be  covered  in  course  content.    It  should 
be  possible  to  make  a  conpromise  by  collecting  data  that  falls  somewhere 
between  the  level  of  detail  outlined  in  the  College  Board  report  and  the  gross 
categories  that  we  normally  use.   For  exanple,  it  may  be  very  useful  to  know 
how  many  students  have  passed  course  work  in  algebra  and  geometry.   Oiis  may 
be^  more  ijiportant  than  knowing  what  the  quantiutive  score  of  a  group  of 
students  was  on  the  Scholastic  Aptitude  Test  (S.A.T).   At  the  high  sdiool 
l^el,  it  is  possible  to  identify  cerUin  key  courses  such  as  algebra,  general 
chemistry,  foreign  language,  first-year  for-^ign  language,  college  preparatory 
English,  etc.  and  to  determine  what  proportion  of  the  students  have  oonpleted 
the  key  courses.   Oiis  leads  us  away  from  dependency  on  normative  daU  and 
towara  more  meaningful  criterion  data. 

'  Specific  Reconmendation:   Work  with  Chief  State  School  Officers  to 

develop  a  ooomon  nomenclature  for  key 
academic  courses.   Collect  and  r^rt  data 
based  i^on  this  nonmenclature. 

C.   An  academic  success  criterion.   At  present,  the  use  of  the  S.A.T.  or  the 

A.C.T.  at  the  end  of  a  high  school  program  as  a  measure  of  acaoeraic 
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dchievement  is  seriously  proolematic.    The  absence  of  meaningful  and  viable 
alternative  is  also  seriously  problematic. 

There  is  a  logic  associated  with  the  whole  data  collection  system  as  it 
now  stands.    Ihat  logic  may  also  force  us  inevitably  to  the  conclusion  that 
there  is  a  need  for  some  uniform  measure  of  academic  performance  at  the 
national  level.    To  my  knowledge,  no  test  publisher  has  ever  nade  claims  to 
the  effect  that  any  instrument  published  by  th^  was  indeeo  a  valid  universal 
measure  of  acaoemic  achievement.   Rather,  users  are  left  to  determine  (based 
upon  their  own  analysis)  if  the  match  between  test  content  and  the  academic 
objectives  that  they  espouse  is  sufficient. 

Anothfr  major  problem  with  the  use  of  the  S.A.T.  and  the  A.C.T.  stems 
first  ana  foremost  from  the  fact  that  it  is  necessary  to  determine  if  the 
tests  are  consioereo  to  be  measures  of  'aptitude'  or  measures  of  'achieve- 
ment.'  Sometimes,  the  word  'ability'  is  used  to  describe  tests  such  as  the 

or  However,  t.ie  use  that  is  made  ot  such  tests  reflects 

confounding  in  the  minds  of  users  regarding  the  nature  of  the  test  as  either 
aptitude  or  achievement.   Most  often,  users  attempt  to  stand  in  both  places  at 
the  same  time~inplicitly  claiming  that  the  tests  are  both  aptitude  and 
achievement. 

Ihe  significance  of  this  (for  the  National  Data  collection  effort)  is  that 
ultimately  a  choice  must  be  made  between  these  two  options.  Ghee  having  been 
maoe,  the  tests  must  be  evaluated  according  to  the  appr^riate  rules  for 
evaluating  the  particular  type  of  test  that  it  is.   For  exairple,  if  it  is  an 
achievement  test,  it  must  evaluated  according  to  the  niles  for  determining  its 
content  valioity  for  a  high  school  curriculum.   Ihis  brings  up  the  awesome 
problm  of  validity  of  the  criterion,  the  school  curriculum.    Little  neeos  to 


ERLC 


250 

271 


oe  saiQ  aoout  tne  acsence  o£  uniformity  in  tne  hign  scnool  curriculum, 
Stanaaraizea  testing  for  a  non-standard  curriculum  is  an  absurd  practice.  In 
tne  absence  of  more  uniforra  curricula,  the  test  cannot  be  content  valid. 

If  it  lo  an  aptituoe  test,  then  it  must  be  evaluated  accoraing  to  the 
rules  fro  determining  predictive  validity,  taking  into  account  the  variation 
in  instructional  quality  that  intervenes  between  initial  teaching  and  final 
testing.    For  example,  if  these  tests  are  regarded  as  aptitude  tests,  the 
results  of  studies  of  coachii»g  effects  should  give  real  cause  for  pause. 
(Messick,  1980)  (The  Federal  Trade  Ocaimission  Study,  1979)    It  has  been  shown 
that  stancjardized  tests  scores  can  be  raised  significantly  by  well-designed, 
short-term  coaching  courses.    Ihis  should  not  be  the  case  if  the  test  is  a 
test  of  "aptitude."   Perhaps,  the  only  reasonable  resolution  to  this  problem 
is  to  call  upon  Qiief  State  School  Officers  to  take  the  lead  in  establishing 
the  uniformity  in  academic  goals  at  a  basic  level  that  would  permit  test 
publishers  to  develop  tests  based  on  cofODon  understandings. 

Such  an  approach  is  not  without  its  dangers— the  most  obvious  of  which  is 
the  loss  of  local  control  over  curriculum  decision  making.   The  issue  here  is 
more  one  of  a  policy  matter  than  a  technical  one.   Itotil  we  get  to  the  point 
ot  consioering  whether  certain  ijii»rtant  educational  objectives  can  be 
measures  by  traditional  forms  of  paper  and  pencil,  niltiple  choice  testing. 
At  that  point,  another  policy  issue  presents  itself:   «iat  costs  wUl 
eaucators  accept  for  the  quality  assessment  of  academic  achievement? 

Many  things  in  the  national  data  collection  plan  are  linked  to  achievement 
test  results.   Achievement  test  results,  for  better  or  for  w.rse,  are 
consioereo  to  be  the  •bottom  line"  in  the  data  collection  effort.  Oierefore, 
the  stakes  are  very  high.   IJiere  is  a  critical  need  for  valid  outcome  measures. 
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Specific  Recomrenoation:    work  with  Chief  State  School  Officers  to 

oevelop  standaraization  in  testing  that  is 
feasiole  and  appropriate.    Collect  anc 
report  achievement  data  from  these  new 
ineasures. 

General 

in  general,  the  present  categories  of  oau  collection  are  appropriate. 
•    Reliaoility  ana  validity  must  be  the  major  concern,    ihis  is  the  main  way  to 
inprove  present  data  gathering  efforts. 

Strong  support  should  be  given  to  the  High  School  and  Beyond  Survey,  it 
IS  one  of  the  few  places  where  individual  students  are  tracked.   Moreover,  as 
a  longitudinal  stuoy,  it  will  be  a  rare  contribution  to  our  knowledge  base. 

Ihe  Ubrary/Media  Center  Survey  is  in^jortant.    However,  it  is  not  clear 
tnat  qualiutive  juogments  can  be  maoe  from  the  quantitative  data  to  be 
collected.    If  there  were  a  report  that  suimarized  the  holdings  by  titles 
Within  categories,  it  would  be  much  easier  to  perform  evaluations  of  the 
quality  of  holdings.   For  exanple,  what  is  the  pattern  of  holdings  in  typical 
schools,   sunmative  information  on  these  patterns  is  desirable. 
Ihe  iwentietn  Centurv 

Oie  of  the  most  interesting  things  about  progress  is  that  the  more  some 
things  change  the  more  others  stay  the  same.   Most  of  us  have  witnessed 
pnenomenal  changes  in  the  availability  of  technology  such  as  television, 
corputers,  genetic  engineering,  space  travel,  etc.    indeed,  the  content  of 
school  curricula  now  reflect  this  new  information.   And  yet  the  requirements 
for  a  basic  elementary  and  high  school  education  of  quality  are  really  not  all 
that  oifferent  tooay  than  they  were  decaoes  ago.   As  we  try  to  prepare 
Children  -for  life-  or  for  the  -work  of  work,'  we  find  that  both  of  these 
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areas  call  for  stuaents  who  are  skilleo  ar  reading,  computing,  analytical  ana 
syntnetic  thinking,  written  and  oral  expression,  and  a  whole  host  of  'liberal 

arts  sKills.'  (Aaler,  ) 

We  shoula  have  learned  by  now  hat  the  best  preparation  for  the  world  of 
work  at  the  high  school  level  is  a  gooa  sound  acaoendc  ana  social  educational 
experience.    First,  high  technology  m  the  workplace  does  not  seem  to  increase 
the  call  for  'high  teen"  30DS.    (Levine  and  Rumoerger,  1983).    Ihe  u.  S. 
Department  ot  Labor  confirms  the  fact  that  the  growth  areas  for  eirployment  are 
in  the  low-skilled  service  sectors  of  the  economy.    It  is  hard  to  train 
students  for  specific  jobs  that  matter  at  the  high  school  level.    Second,  the 
aovanced  level  jobs  and  personal  satisfaction  in  life  require  a  sound  general 
eoucation,  not  different  in  kind  than  that  which  we  have  described  many  times 

before.    (Adler,  ) 

■    The  best  role  of  data  gathering  on  education  for  public  policy  decision 
miking  is  a  role  that  supports  the  most  refined  description  possible  of  what 
takes  place  in  the  sdi^ols.   It  is  essentially  an  operation  that  functions  in 
support  of  quality  control  and  equity  guaraPitees. 

Ultimately,  our  mission  in  eaucation  must  be  to  serve  our  people.   Vte  do 
that  by  being  cognizant  of  the  demands  of  the  econcnry.   But  we  can  never 
neglect  the  thing  that  we  have  always  heard  articulated.   A  democratic  society 
is  dependent  upon  an  educated  citizenry.   This  means  that  our  vision  for  the 
nation's  schools  is  that  they  are  instruments  that  build  the  capacity  of 
stuaents  to  think.    Ihe  schools  are  instruments  that  confront  them  with  the 
inportant  things  that  citizens  must  ponder.    In  this  regard,  the  twentieth 
century  is  not  unlike  previotis  centuries,  except  perhaps  the  gap  betwer  or 
ioeals  and  reality  can  be  closed  if  we  can  see  reality  more  clearly. 
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EDUCATIONAL  STATISTICS  FOR  EDUCATIONAL  POLICY: 
A  POLITICAL  ECONOMY  PERSPECTIVE 


The  enviponment  of  the  educational  system  is  becoming  more 
uncertain.  The  American  economy  is  in  a  period  of  transition:  employment  in 
basic  industries  is  in  decline  relative  to  employment  in  the  service  sector, 
and  the  character  of  the  national  economy  is  increasingly  determined  by  an 
international  division  of  labor.  Birth  rates  are  declining*  while  rates  of 
inter-regional  migration  are  high.  School  reform  is  once  again  a  national 
preoccupation  and  proposals  for  changes  in  basic  and  higher  education  have 
been  put  forward  in  virtually  every  atate  in  response  to  perceived  inadequa- 
^  cies  in  the  performance  of  the  schools.  Proposals  for  federal  tax  reform 

threaten  the  traditional  financial  basis  of  the  public  schools,  while  discussion 
of  tuition  tax  credits  and  educational  vouchers  challenges  the  privileged 
status  of  public  schools  within  the  educational  system. 

When  faced  with  uncertainty,  the  Wicked  Queer  in  "Snow  White' 
ran  to  her  mirror:  omniscient,  timely,  and  truthful,  the  mirror  gave  her  the 
information  she  required.  Educational  policy  makers  have  no  such  recourse. 
In  uncertain  times  they  are  often  obliged  to  act  on  the  basis  of  information 
that  is  sketchy  and  unreliable,  and  of  limited  relevance  to  the  decisions  they 
must  make,  Thia  need  not  be  the  case.  The  expanding  activity  of  the 
federal  government  in  the  collection  and  disaaminetion  of  the  data  and  the 
rapid  development  of  the  information  technologies  now  make  it  possible  to 
provide  educational  policy  makers  with  access  to  reliable,  timely  data  on 
many  of  the  critical  issues  they  face.    The  National  Council  on  Education 
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Statistics  should  play  a  leading  rote  in  compiling  chese  data  and  ensuring 
their  availability  to  those  who  need  them. 

In  this  paper  we  discuss  some  of  the  ways  in  which  NCES  might 
reorient  its  activities  in  order  to  assist  educational  policy  makers  in  making 
informed  decisions.  The  paper  is  organized  in  three  sections.  The  first 
section  discusses  the  relationship  between  the  educational  system  and  its  tax 
base.  The  second  section  of  the  paper  proposes  that  policy  relevance  rather 
than  convenience  should  determine  the  levels  of  aggregation  of  educational 
statistics.  It  also  argues  that  decentralization  in  data  collection  will  faci- 
litate access  and  encourage  relevance.  The  third  is  concerned  with  the 
maintenance  of  uniformly  high  standards  of  reliability  and  comparability  in 
NCES  data.  It  points  out  the  dangers  in  confusing  informational  and  regula- 
tory data  bases,  and  urges  that  the  two  be  kept  entirely  separate. 
Tracking  the  Investment  Cycle 

An  increasingly  complex  economic  end  technical  environment  ii 
changing  the  atructure  of  educational  policy  making.  Public  support  of 
education  is  at  least  partly  grounded  in  the  belief  that  education  contribute 
to  economic  development.  Concern  about  the  returns  to  past  investments  in 
public  schooling  underlie  many  current  efforts  to  reform  the  schools.  The 
development  of  the  future  tax  base  must  be  a  priority  for  educational  policy 
making  over  the  next  decade.  Without  access  to  an  adequete  source  of 
funding*  excellent  educational  programs  will  do  the  next  generation  of  tax- 
payers  little  good.  The  current  school  reform  effort  must  recognize  that 
education  is  a  means  to  an  end*  and  not  en  end  in  itself. 

Education  can  be  viewed  ao  a  middle  product  in  a  public  invest- 
ment cycle.  Taxpayers  can  be  seen  as  investors  in  those  goods  and  services 
thet  would  not  receive  adequate  provision  in  completely  privete  markets. 
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They  invest  in  education  primarily  through  property,  sales  and  income  taxes. 
Taxpayers  in  a  democracy  elect  those  who  set  taxes,  thus  exercising  seme 
degree  of  choice  in  the  development  of  educational  policies.  Local,  state  and 
federal  governments  are  then  charged  with  investing  these  resources  in  edu- 
cational  programs,   which   in   turn,   are   reinvssted   resources  in  students. 
(Students  also  invest  their  own  resources  in  education,  primarily  in  the  form 
of  time.)  Eventually  students  enter  a  labor  market  and  invest  their  human 
capital  and  time  in  return  for  a  wage.     They  then  close  the  investment 
cycle  by  becoming  the  next  generation  of  tax-paying  investors.   Each  invest- 
ment  in  the  sequence  occurs  under  conditions  of   uncertainty,  and  each 
consequently  requires  an  appropriate  level  of  return  to  compensate  for  its 
risk.     T^fe  adequacy  and  type  of  return  to  the  educational  investment  is 
primarily     a  function  of  the  investors'  standards  and  percepi-ions  of  the  re- 
turns to  alternative  investments. 

Excspt  at  the  national  level,  tax  bases  iire  not  pooled.  Local 
property  taxes  invested  in  a  community's  children  may  not  produce  m  return 
If  those  children  enter  the  labor  market  in  other  communitieb\  If  there  is  s 
balance  of  in  and  out  migration,  local  governments,  states,  and  regions  do 
r.3t  have  to  be  overly  concerned  about  tracking  their  investmenta.  If  local 
and  state  investmenta  In  human  capital  ultimately  subsidize  their  economic 
competitors,  however,  then  policy  makers  will  eventually  restructure  their 
educational  investment  policies  appropriately. 

The  federal  government  can  provide  a  aervice  both  to  the  educa- 
tion community  and  to  national  economic  development  by  Initiating  a  series 
of  regional  data  bases  that  accurately  track  educational  investment  cycles  in 
both  public  and  private  sectors.  While  local,  state  and  private  sources  can 
help  to  support  the  initiative,  the  federal  government  through  NCES  should 
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set  standards  for  data  collection,  insure  comparabil'ty  and  timeliness,  and 
provide  computer  networking  systems  for  decentralized  access. 

A  high  quality  system  of  Infi^rTiatlon  could  encourage  cooperative 
efforts  among  policy  makers  and  researchers  at  all  levels.  These  efforts 
could  result  in  a  more  flexible*  more  responsive*  and  finally  more  productive 
educational  enterprise. 

Education  is  one  of  the  nation's  most  broadly-based  investments  in 
future  tax  base  renewal.  It  is  also  a  nationally  contained  investment.  While 
regional  economic  competition  may  create  some  policy  friction,  from  a  na- 
tional perspective  the  resources  invested  in  citizens  have  only  minimal 
leakage,  because  relatively  little  human  capital  migrates  and  subsidizes  for- 
eign economic  competitors.  National  aducacional  investments  for 
development  contrast  with  the  public  subsidization  of  private  corporations 
for  the  same  and.  Corporations  can.  with  relative  eaae«  export  thair  invest- 
ments and  indirectly  subsidize  rntarnational  competitors.  Educational 
investments  present  lower  risks  for  public  investors. 

Unfortunately,  relatively  little  is  known  abou:  the  investment  link- 
ages between  education  and  national  economic  competitiveneaa.  Even  this 
lin.Ited  knowledge  is  eroding  in  e  transitional  economy  with  a  murky  future. 
In  the  fifties  and  sixties,  there  was  a  widespread  belief  in  the  contribution 
of  mass  public  education  to  economic  development.  The  American  model 
was  exported  to  developing  nations  with  gre.  ^  fervor,  but  with  little  solid 
information. 

Challenges  to  this  confidence  in  public  education  surfaced  in  the 
mid^eventies  as  the  momentum  of  the  American  economy  waned.  These 
challenges  have  generated  intense  criticism  of  the  public  school  system  and 
a  variety  of  proposals  for  school  reform.  The  educational  community  will 
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continue  to  face  criticisms  of  its  investment  decisions  into  the  next  decade* 
Lacking  adequate  information,  policy  makers  are  likely  to  make  decisions  in 
response  to  the  pressures  of  the  moment*  rather  than  to  seek  out  produc- 
tive, long-term  educational  investments. 

According  to  a  recen*:  Urban  Institute  study,  the  average  current 
wage  earner  from  the  'baby  boom'  generation  earns  ten  percent  less  in  real 
terms  than  did  the  average  wage  earner  in  the  prior  generation.  Yet  the 
'baby  boom'  generation  waa  the  recipient  of  extraordinary  public  educational 
investments  of  the  fifties  and  aixties.  Is  this  merely  a  temporary  labor 
oversupply  problem  that  will  clear  in  the  next  generation,  cr  are  these  re- 
turns  a  portent  of  the  economy  of  the  future?  No  one  has  an  adequate 
mirror. 

If  educational  policy  makers  at  any  level  cannot  track  their  edu- 
cational investment  cycles,  they  may  incorrectly  identify  the  problems 
requiring  attention  and  inadvertently  generete  policiea  which  result  in  costly 
unintended  consequences.  Educational  delivery  systems  which  may  have  been 
both  appropriate  and  auccessful  under  different  economic  and  technological 
conditiona  may  hinder  economic  development  under  new  conditions.  For 
example,  en  economy  with  aaaumed  growth  cen  bear  greater  nonproductive 
distributive  burdena  than  one  with  uncertein  future  growth. 

The  less  thet  ia  known  about  current  delivery  systems  and  their 
impact  on  development,  the  riakier  educational  policy  making  becomes  in  the 
fece  of  economic  trensition.  A  high  quelity  integrated  data  base  can  pro- 
vide a  basis  for  reducing  that  riak. 

The  investment  cycle  cen  b9  tracked  in  e  veriety  of  ways.  Sets 
of  individuels  should  be  followed  through  their  educational  careers  and 
through  the  lebor  market*  building  on  the  High  School  and  Beyond  study* 
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Tracer  studies  should  track  students  through  alternative  educational  programs 
into  the  labor  market.  These  studies  should  include  fuller  and  deeper  link- 
ages with  the  labor  markets  and  migration  patterns. 

Schoolfffsite  resource  allocation  patterns  of  investment  can  be 
tracked  through  comparable  measures.  NCES  could  carefully  examine 
detailed  expenditures  across  a  representative  sample  of  school  sites.  Com- 
parable data  could  be  collected  on  direct  and  indirect  fixed  and  variable, 
program,  and  logistical  support  costs.  Outcome  measure  from  these  sites 
could  be  used  to  examine  the  cost  effectiveness  of  current  practices. 
Detailed  environmental  data  could  also  be  integrated  to  the  site  data  base. 

Finally,  measures  of  educational  investments  in  economic  develop- 
ment might  be  most  appropriately  tracked  at  a  regional  level,  both  to  avoid 
problems  of  data  collection  ot  too  broad  a  level  of  aggregation  and  to  follow 
the  flows  of  educational  capital  across  rey'ons.    NCES  should  not  engage  in 
direct  collection  at  this  level  but  csn  play  a  vary  useful  role  by  coordinat- 
ing, and  editing  existing  data  from  other  sources.    At  regional  levels  these 
would  include  comparable  information  about  tax  bases  and  tax  effort,  voter 
responses  to  tax  initiatives,  labor  market  patterns  and  trends  In  employment 
by  sector,  detailed  in  and  out  migration  patterns,  demographic  structures, 
economic  indicators  such  as  housing  starts,  and  public  expenditures  by  sec- 
tor. Good  mirrors  are  expensive,  but  invaluable  to  policy  makers. 
Individuala.  Sites.  Regions 

A  central  issue  in  public  data  collection  over  the  next  decade  will 
be  the  aggregation  problems  connected  with  public  investment.  There  ere 
major  gaps  between  policy  and  research  questions  and  available  data.  For 
example,  how  do  local  and  regional  investments  in  education  ".ffect  the 
regional  and  national  economies?    What  are  the  tax  base  return,  from  public 
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investments  in  individual  students?  How  is  the  school  reform  movement 
working  at  the  level  of  the  school  site?    These  questions  cannot  be  answered 

with  present  NCES  data. 

The  aggregation  problem  is  exacerbated  by  an  increasing  slippage 
between  economic  markets  and  the  scope  of  public  policy  makers.  Economic 
boundaries  are  fluid,  es  capital  flows  in  and  out  of  cities,  regions  and 
nations.    Political  bound- 
aries are  somewhat  more  rigid,  es  politicel  etebility  rests   on  defined  terri- 
tory. Where  economic  end  politicel  boundaries  ere  coincident.      public  and 
private  interests  ma/  coincide  as  well.     As  boundaries  diverge,  however, 
sectoral  slippage  increeses.  For  example,  local  investment  in  public  schools 
may  pay  off  when  graduates  remain  in  the  community  to  regenerate  the 
local  tax  base.  If.  however,  the  community's  public  school  qreduates  leave 
the  community    end  el  low  the  returns  to  public  investment  in  their  educa- 
tion to  accrue  to  the  community'*  competitors,  then  investments  in  public 
educetion  msy  result  In  net  losses  for  thet  community. 

NCES  cen  play  a  crucial  role  In  the  formuletion  of  educetionel 
policies  by  providing  high  qusllty  Informstion  to  policy  mskers.  Relieble. 
velid.  timely  informetion  could  both  provide  the  education  sector  with  e 
competitive  edge  end  help  to  melntein  stsndsrds  of  quelity  In  public  Invest- 
ment. These  dete  should  be  collected  et  natural  economic  levels  of 
eggregation:  IJ  Individual  achievement  end  economic  performence  over  time. 
2)  school  site  productivity  and  3)  regionel  economic  returns  on  educetionel 
investments. 

NCES  in  coopfcrstion  with  other  federal  date  collecting  egencies 
should  establish  s  nstlonsi  trscer  dete  bese  to  follow  Indlvlduels  through  the 
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public  investment  cycle.  Individuals  carry  with  them  public  investments  in 
their  human  capital.  These  investments  are  not  evenly  distributed  across 
students.  Test  scores  measure  outcomes  for  the  relative!/  ihort  term,  but 
additional  measu»es  of  intermediate  and  long  term  effects  vould  make  possi- 
ble a  more  accurate  tracking  of  the  educational  investment  cycle.  In 
addition  to  tests,  intermediate  term  indicators  should  measure  the  return  on 
the  public  investment  in  the  labor  market.  Tracer  studies  should  track  stu- 
dents from  different  backgrounds  through  alternative  educational  programs 
(private/public,  acadamic/vocational/ganaral)*  into  the  market  place.  The 
Bureau  of  Labor  Statistics  and  others  could  then  assist  in  tracking  their 
progress. 

Long-term  measures  should  go  beyond  income  as  economic  indica- 
tors of  a  return  on  investment,  because  income  does  not  close  the 
investment  cycle  for  public  education.  Education  revenues  are  atill  drawn  for 
the  most  part  from  property  rather  than  income  taxes,  and  property  taxes 
are  by  definition  tied  to  the  economic  health  of  regions.  The  financial  basis 
of  public  education  assumes  stability  in  the  investment  cycle:  local  commu- 
nities and  states  invest  in  public  education  so  that  graduetes  will  provide 
returns  as  property  owning  citizens  in  the  future.  Disruptions  in  this  cycle 
caused  by  net  in  or  out  migration  disturb  the  community's  expectations  of  a 
return  on  its  investments  in  education  and  elter  tax  payers"  willingness  to 
support  the  schools. 

Another  neglected  level  of  data  collection  is  the  achool  site. 
School  sites  are  the  most  important  levels  of  aggregation  for  assessing  the 
impact  of  the  school  reform  movement.  They  beer  the  burden  of  the  regu- 
lation generated  by  legisletive  initiatives  and  community  response.  School 
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districts,  intermediate  units  and  states  are  less  interesting  and  relevant  lev- 
els of  aggregation  than  school  sites  for  the  measurement  of  the  impact  of 
educational  policies. 

NCES  should  select  a  representative  sample  of  school  sites  from 
which  to  collect  a  rich  base  of  information  about  the  relationship  between 
school  site  investments  and  educational  outcomes.  Individual  studies  have 
been  conducted  in  this  area,  but  a  national  longitudinal  effort  comparing 
public  anc;  private  •chool  sites  ■cross  regions  would  provide  rssesrchers  end 
policy  makers  with  integrated,  reliable  information  with  which  to  track  the 
progress  of  school  reform  initiatives. 

Site  indicators  should  include  regulation  costs  to  track  the  time 
and  resource  response  costs  of  centralized  policy  initiatives.  Also  while 
NCES  has  collected  data  from  private  schools,  a  much  more  comprehensive 
picture  of  site  costs  of  sltsmative  education  investments  is  in  order. 

Policy  makers  mun  wrestle  with  serious  questions  about  the 
returns  on  investment  In  public  education.  Would  deregulation  through 
increased  competition  raise  or  lo.^er  teacher  wages  in  a  free  market? 
Would  deregulation  increase  the  sector's  investment  in  low  cost  lebor  intense 
practices  or  would  there  be  ■  shift  towerd  lower  cost  physicel  technology? 
Before  such  pressing  questions  can  be  eddressed  rrore  must  be  known  ebout 
the  BCtuBl  costs  of  educating  different  types  of  students  under  elternative 
conditions. 

Mt  the  regionel  level,  NCES  can  provide  e  velueble  service  by 
supporting  integrated  data  bases  which  more  closely  link  public  investments 
and  economic  returns.  Regionel  date  bases  can  more  eccuretely  treck  the 
interplay  between  private  end  public  Investment  and  return;  therefore,  the 
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effects  of  educational  investments  on  tax  bases  generated  by  human  capital 
circulation  and  savings  can  be  measured  more  meaningfully. 

While  policy  making  will  continue  at  local  and  state  levels, 
regional  data  bases  can  provide  decision  makers  with  higher  quality  -nforma- 
tion  than  if  data  are  collected  at  more  artificial  levels  of  economic 
aggregation. 

The  interaction  between  education  investment  and  the  economy  is 
complex,  and  data  aggregated  at  the  national  level  mask  the  Important 
effects  of  externalities  generated  by  regional  subsidization  of  local  and  other 
regional  economies.  Failure  to  recognize  these  effects  may  lead  to  inaccu- 
rate predictions  about  the.  expectations  and  behavior  of  taxpayers,  and  to  a 
misunderstanding  of  the  performance  of  regional  economies.  Over  a  longer 
term  these  effecu  could  be  substantial. 

The  federal  government,  by  sponsoring  integrated  comparable 
regional  data  bases  could  encourage  decentralized,  coordinated  decision  mak* 

i 

ing  for  economic  development.  Economic  regions  cut  across  state  lines,  and 
regional  data  bases  would  lower  the  costs  of  accurate,  timely  and  accessible 
data  for  policy  makers  at  local,  state  and  federal  levels  by  reducing  the  du- 
plication of  affort.  increasing  the  data  collection  investment  pool,  and 
encouraging  greater  cooperaticn  in  regional  development  efforts.  These  data 
bases  would  not  only  track  regionel  investment  cycles  but  would  also  provide 
comparable  data  for  tracking  national  treniJa. 

Regioral  data  bases  elso  make  technicel  sense.  NCES  can  help  to 
coordinate  federal  inter-agency  efforts  to  link  public  investment  to  tax  base 
return.  The  Census  Bureau,  the  Bureau  of  Lodor  Statistica.  the  National 
Science  Foundation  (NSF).  the  Department  of  Commerce  and  meny  other 
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agencies  collect  infopmation  which  is  vital  to  the  trackin&  of  economic 
development.  These  departments  should  work  more  closely  with  their  coun- 
terparts at  state  and  local  levels  to  insure  accurate.  cor.<parable.  timely  data 
at  regional  levels. 

Recent  technological  developments  can  provide  momentum  in  these 
new  directions.  Supercomputers  can  process  complex  dynamic  models  that 
until  recently  were  only  theoretically  possible.  A  high  quality  regional  data 
base  could  support  more  aophisticatsd  modeling  or  public  investment  cycles. 

NSF  has  sponsored  a  series  of  Cray  supercomputers  for  ecademic 
use.  A  cooperative  effort  between  NCES  and  NSF  could  pilot  a  regional  data 
base  to  track  a  public  educatioral  investment  cycle.  Initially  it  would  be 
better  to  focus  resources  on  a  single  high  quality  data  base  than  to  lower 
the  quality  of  data  collection  by  underfunding  e  more  broad  based  effort. 
Under  these  conditions,  investment  in  e  pilot  data  base  could  lead  to  lower- 
cost  implementetion  of  e  refined  end  expended  system  et  e  leter  date. 
State,  locel  end  privete  investors  could  be  encouraged  to  bid  for  the  experi- 
mentel  informetion  base. 
Collection  Critarle 

In  the  past  NCES  has  not  been  known  for  high  quality  indicators 
and  date  collection.  There  ehould  be  no  compromise  on  stendards  of  quality 
in  a  refocused  progrem*  The  criterie  for  NCES  data  collection  should  in- 
clude: 1]  persimony.  2]  eccurecy.  3}  comperebility.  timeliness  end.  5) 
eccessibility. 

Par:.:mO[  is  paramount.  Cvercollection  of  data  at  low-cost  levels 
of  eggregation  is  wasteful  end  of  little  use  to  policy  mekers.  The  nature  of 
the  dete  collected  by  NCES  ehould  be  determined  by  long-renge  usefulness. 
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What  are  the  important  questions  that  policy  makers  and  researchers  will  be 
asking  over  the  next  decade?  What  resources  are  required  to  support  long 
term  maintenance  of  high  quality  indicators?  Less  is  more  if  fewer  items 
of  data  are  collected  at  more  appropriate  levels  of  aggregation,  even  if  tnis 
means  higher  costs  per  item  of  data.  If  NCES  is  to  serve  as  a  role  model 
for  a  refocused  federal  information  system*  then  enough  care  should  be  in- 
vested in    it  to  make  it  cost  effective  in  the  long  term. 

Accuracy  ia  an  acute  quality  control  issue.  It  requires  unambig- 
uous standards  of  tolerance  that  are  frequently  monitored.  Indicators  must  be 
defined  in  clearly  measurable  terms.  Opinion  poll  information  can  be  useful 
to  policy  making  if  the  data  standards  are  considered  excellent  by  experts 
and  the  methods  and  standards  employed  in  collection  and  interpretation 
are  easily  accessible.  Access  to  raw  data  for  reinterpretation  should  be 
considered. 

Comparability  counts.  Crossectional  financial  data  comparisons 
are  currently  impossible  bscause  financial  data  are  collected  for  idiosyncratic 
regulatory  purposes.  LongitudinsI  oats  comparisons  hsva  not  hsd  formsU 
consistent  long-term  tracking  commitments.  For  example,  the  quality  of 
minority  representation  data  has  eroded  over  the  last  decade.  Longitudinel 
data  comparability  should  require  firm*  ten-year  commitment  levels.  NCES 
should  encoursge  states  to  collect  at  least  minimal  amounts  of  comparable 
crossectional  and  longitudinal  data,  especially  within  regions.  The  lack  of 
such  data  obliges  policy  makers  to  make  decisions  without  'sn  adequate  sup* 
ply  of  information. 

The  lack  of  timeliness  in  educational  data  collection  is  shameful. 
Lag  times  in  reporting  are  often  measured  in  years  Instead  of  days  or 
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months.  This  is  a  serious  underinvestment  in  data  collection  activities. 
Policy  makers  require  timely  data  for  decision  making  and  should  be  willing 
to  p£y  ror  it. 

Accessibility  is  an  absolute  requirement  of  a  rafocused  federal 
information  aystam.  Networking  systems  can  now  be  established  to  allow 
highly  decentralized  use  of  data.  This  requires  the  capacity  to  download 
files  into  other  systems  and  the  availability  of  highly  sophisticated  user- 
friendly  aoftwara  so  that  quaationa  can  be  addresaad  with  minimal  inconven- 
ience. In  addition  to  a  user-friendly  data  base  management  system.  NCES 
should  sponsor  the  development  of  expert  systems  to  interface  with  central 
ddta  bases  so  that  policy  makers  can  ask  questions  and  receive  timely  an- 
swers in  a  useful  format.  Accessibility  could  additionally  include  easy 
interface  with  graphic  ayatema.  atatistical  packages,  and  •what-if"  scenario 
packages. 

Networking  through  NCES  might  also  provide  access  through  the 
system  to  data  bases  maintained  by  other  agencies.  Access  to  multiple  data 
bases  could  be  useful  In  tracking  national  and  regionel  investment  cycles. 

HiQh  quality  data  collection  can  influence  the  process  ea  well  ai 
the  outcomes  of  policy  making  end  research.  NCES  should  invest  in  studies 
with  NIE  and  other  agancias  to  study  the  potentiel  impact  of  this  Influence. 

Quality  can  be  produced  if  aufficiant  incentives  are  available.  NCES 
may  went  to  provide  incentives  for  queltty  through  the  use  of  fees  for  serv* 
ices  and  user  cherges.  NCES  could  contrect  with  school  sites  and  other 
agencies  for  deta.  Policy  makers  should  be  willing  to  invest  in  data  collec- 
tion that  cen  pr&vide  them  with  aupport. 
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While  data  collected  for  NCES  could  serve  to  monitor  regulatory 
costs,  they  should  not  be  used  for  regulation  for  at  least  three  reasons. 
First,  monitoring  requirembr.-s  tend  to  result  in  highly  specialized,  complex 
and  cumbersome  data  requirements.  Second,  regulation  by  definition  intro- 
duces reporting  biases,  thus  distorting  accuracy  and  reducing  the  credibility 
of  the  data  base.  Threatened  administrators  could  stall  in  reporting  and 
processing  data  to  reduce  timeliness.  Third,  secrecy  is  often  a  major  compo- 
nent of  regulated  systems.  The  NCES  system  should  be  known  for  its  wide 
accessibility  through  multiple  networking  systems. 

While  omniscience  is  beyond  the  reach  of  any  federal  inormation 
system,  timeless  and  truthfulness  should  be  the  objective  of  al!  NCES  activi- 
ties. NCES  should  strive  to  answer  those  questions  that  policy  makers  esk. 
not  those  that  are  easy  or  inexpensive  to  address,  ard  every  effort  should  be 
made  to  ensure  that  the  answers  are  based  on  reliable,  timely  data.  NCES 
should  be  seen  by  policy  makers  as  the  manager  of  a  mirror  for  the  educa- 
tional system,  and  not  a  purveyor  of  poisoned  apples. 


293 

290 


REFERENCES 


C 


ERIC 


Becker,  G.S.  1976.  The  ernnnmir  apprnarh  to  hnmim  hehaviof.  Chicago:  Univereity  of  Chicago  Preis. 
Benjaminjl.  1980.  Th#  limiu  of  polities  Chicago:  Univcnity  of  Chicago  Press. 
Bluestone.  B.  arid  B.  Hairison.  1982.  Th>  H^inriiKtriaiiTarinn  of  America.  New  Yoifc  Basic  Books. 
Bowles.S..  DJ^.Gordon  and  T£.Wcisskopf.  1984.  Rfymrf     wasteland.  Garden  City.  NY:  Anchor  Books. 
Boyer.  EJ-.  1983.  High  ^chnnl-  New  York;  Harper  &  Row. 

Chubb,  J.G.  1981.  The  political  economy  of 'excessive'  regulation.  Project  report  no.  81-A12.  Institute  for  Research 
on  Educational  Finance  imd  Governance.  School  of  Education,  Stanford  University. 

Dean,  E.  1984.  Frfiipation  and  gcnnnmif.  prndiictivitv.  Cambridge,MA:  Ballinger. 

Denison,  EI.  1979.  Arrnunting  fpy  Mnwr  ■•'•""^"'if  ymwth.  Washington.  DC:  Brookings  Institute. 

Drucker,  P J.  1980.  Manapiny  in  fiirhiilont  rimg<!.  New  York :  Harper  and  Row. 

Evcrhart,  KB.  ed.  1982.  The  ouhlic  school  mnnnnnlv.  Cambridge,  MA:  Ballin«?er. 

Feldstein,  M.  1980.  rn>  Ammcan  *ynnoinv  in  tran^itinn.  Chicago:  University  of  Chicago  Press. 

Freeman.  J.  and  M.T.  Hannan.  1981.  Effects  of  resources  and  enrollments  on  growth  and  decline  in  school  districts. 
Program  report  no.81-Bl.  Institute  for  Research  on  Educational  Finance  and  Governance.  School  of  Education. 
Stanfonl  Univenity. 

Freemanjl  J.  1976.  Thg  over-educaKH  Airw^cm.  New  York: Academic  Press. 

Garms,  WJ..  J.W.  Guthrie,  and  L.C.  Pierce.  1978.  ^hnol  finance.  Englewood  Cliffs,  NJ:  Prentice  Hall. 

Goodlad,  J  J.  1984.  AjlactiallaLschfloLNew  York:  McGraw  HilL 

Guthrie,  J.W.  1980.  United  States  school  fmance  poUcy:  1955-1980.  Srhnni  finanrr  nnlirirs  anri  practices,  ed.  J.W. 
Guthrie.  Cambridge^lA:  Ballinger. 

Hannan,  M.T.  and  J.  Freeman.  1983.  School  district  demography  and  governance.  Project  report  no.83-A21  Institute 
for  Reseaitrh  on  Educational  Finance  and  Governance.  School  of  Education^tanford  University. 


Kiist,  M.W.  1984.  The  changing  baiance'in  state  and  local  power  (o  control  education.  Phi  Delfa  Kappan. 
Novembnr:l89-191. 

Kirst,  M.W.  and  W.I.  Ganns.  1980.  The  poliacal  environment  of  school  finance  poUcy  in  the  1980's.  SdiQQl 
finmrf  poliriot  and  practiee<.  ed.  J.W.  Guthrie.  Cambridge,  MA:  Ballinger. 

300 


291 


Magazincr,  I.C.  and  R.B.  Rcich.  1981  Minding  Amfaica'?;  bu^mf^t:^:.  New  Yort  Vintage  Books. 

Pogrow.  S.  1983.  Linking  technology  use  to  school  improvement  School  finance  and  school  improvement  ^ri  a 
Odien  and  LJ5.Wcbb,n7-142,  Cambridge,  MA:  Ballingci. 

Reich.  R.B.  1982.  The  next  Amgrican  fronHgr  Mgw  YcA:  Times  Books. 

Rumberger,  R.W.  1984.  The  potential  impict  of  technology  on  the  still  requirements  of  future  jobs  Project  repon 
no.  84.A24.  Institute  for  Ressaicb  on  Educational  FinaiKe  and  Governance.  School  of  Education,  Stanford 
University. 

Schultt.  T.W.  1982.  Investing  in  pgnpV  Berkeley:  University  of  California  Press. 
Sizer,  R.  1984.  Horace's  compromise.  Boston:  Houghton  Mifflin. 

Smith  J.  and  F.  Welch.  1978.  The  ovcreducated  American?  Vol  J.  Proceedings  of  National  Academy  of  Education. 


BEST  COPY  AVAILABLE 

301 


292 


A  Model  for  ^'•C.E.S.  Research  on  School  Organization 
and  Classroom  Practices 


Jajnes  M.  McPartland 
Henry  Jay  Becker 


Center  for  Social  Organization  of  Schools 
Johns  Hopkins  University 


September,  1985 


This  paper  was  commissioned  by  the  National  Center  for  Education 
Statistics  as  part  of  its  effort  to  design  a  10-year  program  of  data 
collection  to  Improve  our  understanding  of  the  nation's  elementary  and 
secondary  education  systems. 


ERLC 


302 

293 


A  Model  for  N.C.E.S.  Research  on  School  Organization 
and  Classroom  Practices 


N.C.E.S.  has  two  principal  data  collection  functions.    The  first  is 
to  produce,  on  a  regular  and  recurring  basis,  important  descriptive 
statistics  on  the  functioning  of  educational  institutions.  Recurring 
descriptive  statistics  provide  comparative  and  historical  measures  that 
help  us  understand  how  educational  services  are  provided  to  people  in 
different  places  and  circumstances. 

The  second  data  collection  function  of  N.C.E.S.  is  to  provide 
information  not  otherwise  available  to  improve  our  understanding  of  the 

consequences  of  different  ways  of  providing  schooling  to  students  

consequences  which,  if  better  understood,  could  lead  to  the  improvement 
of  the  delivery  of  educational  services.    It  is  this  second  data 
collection  function— gathering  data  for  understanding  and  improving  now 
schools  provide  instruction— that  is  our  own  primary  interest  and  is  the 
focus  of  this  paper. 

The  paper  has  three  parts.    First,  we  present  a  model  of  important 
aspects  of  the  provision  of  instruction  in  schools  that  prior  research 
suqqerts  may  make  the  most  difference  in  student  outcomes.    Second,  we  " 
describe  the  type  of  research  that  we  feel  is  necessary  to  answer 
questions  implicit  in  the  model,  and  we  outline  a  specific  research 
design  that  addresses  these  issues  in  a  concrete  way.    And  third,  we 
provide  a  selection  of  survey  questions  that  would  form  a  portion  of  the 
information  needed  in  a  research  project  such  as  we  have  outlined. 

X»  A  Hadfil  10  iSaidc  Researci^ 

In  order  to  appropriately  discuss  data  collection  strategies  and 
designs  for  an  N.C.E.S.  program  of  providing  data  for  school  J^Pfoy®- 
roent,  we  must  begin  with  a  model  of  the  dimensions  of  school  instruction 
that  are  alterable  by  policy  and  training  of  the  participants  and  for 
which  alterations  might  be  likely  to  improve  at  least  some  important 
outcomes  for  students. 

Figure  1  presents  such  a  model  of  school  factors  and  student  out- 
comes.   The  model  includes  two  key  working  assumptions.    Pifft,  student 
learning  is  most  strongly  affected  by  the  most  proximate  influences  on 
the  individual:    one's  own  home  and  one's  cwn  classroom.    To  represent 
this,  we  have  separated  general  school  factors  from 

conditions  in  our  model,  and  we  show  causal  impacts  on  student  outcomes 
to  come  primarily  from  classroom  conditions  and  student  inputs,  which 
include  home  background. 

Second,  although  classroom  conditions  have  the  most  immediate  impact 
on  student  learning  and  development,  these  classroom  conditions  are^ 
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themselves  facilitated  by  school  organization  and  policy.  Various 
coroM nations  of  school  organization  and  policy  will  enable  effective 
cSS^itions  to  be  established  and  support  their  continuation,  while  other 
combinations  of  school  organization  and  policy  will  inhibit  effective 
conditions  from  taking  root  and  discourage  P""^^*"^*;  Jj. 

represent  this  facilitating  function  in  our  model  by  a  causal  link 
Letween  school  organization  or  policy  and  classroom  conditions.    We  have 
Ssed  the  word  -faailitate"  rather  than  -cause",  because  the  link  t^tween 
school  organization  and  classroom  conditions  is  an  enabling  or  sup- 
porting connection  rather  than  a  determining  connection.  Effective 
Slss??o^Sonditions,  including  excellent  i^strurtional  practices 
appropriate  social  environment,  can  sometimes  develop  in  many 
kinds  of  schools  using  a  variety  of  organizational  structure  and  formal 
TOlilies.    For  example,  an  outstanding  teacher  can  usually  function 
??f;ca?;iy  iS  liTlt  her  own  classroom  regardless  of  the  way  the  school 
is  organized.    Nevertheless,  school  organization  and  policy  can  facili- 
tate the  development  of  effective  teaching. 

There  is  practical  as  well  as  theoretical  significance  to  the 
distinction  we  make  between  "school  organization  and  policy    fa.^tors  and 
•clas«oom  o^rating  condition"  factors  of  effective  learning  env iron- 
m.n?s     We  believe  it  is  possible  to  change  either  set  of  factors  in  a 
SSoSi  i^prSJeirn?  plaJf  SS^  the  changes  In  each  involve  different  kinds 
of^  probl  ems. 

^•Classroom  operating  condition"  factors  include  instructional  ^ 
practices  of  telchers  and  soci^  context  variables  such  as  interpersonal 
ielations  and  normative  climates.    We  have  learned  through  recent 
efforts  St  school  improvement  th^t  it  la  possible  to  directly  iB?to7^ 
U;  iiJt?uc?iSnal  practices  of  teachers  through  staff  feveloj»ent 
programs  with  explicit  training  in  improved  practices  (Gage,  19"' •  B^^t 
KI2use  many  of  the  improved  techniques  for  teachers  require  profes- 
sional iudm^^ents  in  oohstantly  changing  classroom  situations  (for 
«2J^i.?  dScipIine  management  techniques),  the  ^J, ^"jing 

thesf  oMrating  conditions  will  dej^nd  in  part  on  the  Pj^of^jsional 
capabilities  of  .>ach  individual  teacher.    Even  more  problematic  are 
di?ect  improvements  in  social  context  and  interpersonal  factors  of 
riaaariMsm  otseratina  conditions.    Workshop  and  staff  development  mate- 
fdls  tr.  a?tnablJ  (Sloikiver  et  al,  I9S2)  but  their  i»P;<=t« J'^^^"^*^ 
h^e  not  been  carefully  evaluated,  and  even  strong  advocates  of  the 
•^feStivrSShools"  movement  will  admit  that  social  context  factors  such 
aV 'teacher  exp2c?ation^    or  "the  educational  climate"  are  difficult  to 
change  directly. 

Thus,  one  practical  approach  to  school  reform  is  to  improve  the 
proximate  classroom  operating  conditions  ^*^^"%;°5J^i^f?5^!J^„" 
student  outcomes,  but  this  approach  must  be  fble  *:o  directly  alter 
teachers'  (often  idiosyncratic)  instructional  behaviors  and  the  elusive 
informal  and  interpersonal  context  of  instruction. 

A  second  complementary  practical  approach  to  more  effective  e^^^tif 
is  to  work  on  "organisation  and  policy"  factors  in  the  school.    In  our 
model,  we  list  eight  general  factors  in  this  category,  ranging  from 
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school  size  and  grade-span  to  policies  on  how  to  staff,  schedule  and 
group  for  instructional  activities.    While  it  may  be  no  easier  to  change 
organizational  and  policy  factors  than  to  improve  classroom  operating 
conditions,  the  problems  are  different,    with  policy  and  organizational 
change,  the  problems  are  more  likely  to  be  political  and  bureaucratic 
(changing  formal  regulations,  rearranging  spheres  of  influence,  over- 
coming inertia) .    with  change  of  classroom  practices,  the  problems  are 
more  likely  to  involve  limitations  of  individual  competencies  or 
personalities. 

But  there  are  some  clear  advantages  to  making  improvements  at  the 
level  of  policy  and  organization,  because  these  changes  often  will  last 
through  the  inevitable  changes  in  personnel  of  a  school,  they  often  will 
facilitate  improvements  in  a  large  number  of  proximate  classroom 
conditions,  and  they  often  can  be  coordinated  at  the  state,  district  and 
school  levels.    Making  these  improvements,  though,  requires  a  clearer 
understanding  of  how  school  organization  and  policy  changes  can  facili- 
tate improv«nents#in  the  classroom  operating  conditions,  and  what 
practical  approaches  can  induce  reliable  changes  in  the  relevant  school 
organization  and  policy  factors. 

The  distinction  between  the  school  and  classroom  levels  is,  of 
course,  more  complex,  because  organization  and  policy  factors  can  be  at 
the  classro^  lev^i  as  well  as  the  school  level  (for  example,  instruc* 
tional  grouping  practices  in  the  classroom)  and  proximate  operating 
conditions  of  learning  environments  can  also  involve  rchool  level 
factors  (for  example,  relations  between  teams  of  teachers  who  come  from 
different  subject-matter  departments). 

We  next  discuss  the  specific  variables  within  each  of  the  major  parts 
of  our  model,  as  well  as  the  major  potential  causal  r«;Lationships  among 
the  variables. 


student  Jnpulfi 

We  include  student  inputs  in  our  model,  not  because  these  are 
alterable  factors,  but  because  the  effectiveness  of  a  school  depends 
upon  how  well  it  is  designed  to  meet  the  special  needs,  interests  and 
abilities  of  its  students. 

We  believe  the  design  of  effective  schools  requires  close  ittention 
to  student  heterogeneity,  to  peer  group  influences,  and  to  the  socio* 
economic  composition  of  the  student  body. 

Beterogenetty,    for  any  given  age,  students  will  be  at  a  wide  variety 
of  different  stages  of  biological  development,  cognitive  growth,  and 
personal  and  social  maturity.    The  extent  of  this  heterogeneity  grows 
greater  with  increasing  age.    A  cleissroom  may  contain  pairs  of  students 
of  the  same  age  and  sex  whose  academic  and  extra-curricular  performances 
less  resemble  each  other  less  than  they  do  others  who  are  significantly 
younger  or  older  than  themselves. 
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This  Student  diversity  '^^.^"r'^JJi.^^noanirtn'srruSton"""; 
and  cpei.tion  »«/fhool..    School  or|.mz.tion  „„„g.„ents  and 

a^cL^Ji:^noTJiU""  '"^s  to  .^^^^^^  .n,.,e  th. 

StUniion  and  effort  of  these  diverse  students. 

Th,  ««  ame.    We  peer  9roup  plays  a  I»y«^"i.;''^j£iSt"'tte"" 
Sro^-Se^LSUngy^of^  oM^^ 

individual  is  attached,  which  ^J?        '^iSe "ay  dSsrooo  rewards  are 
ihat  Fomote  or  allow  ~S^«nI;ncie;  of  student  tasks  and 

structured,  especially  J^!^  ill  rSStive  priority  placed  on  academic 
•rroSia-cfde^Tc  ftld^t^'^lr  groups  ^  Slav  in,  19S3) . 

ptn^enfbPdY  ^^fi^^iHr  ^tude'r^^^^^ 

and  social  class  nix  of  V^e  composition  is  a  major  influ- 

has  strongly  "9n?^*^,^^!hfo£  5  school  <cSeman  et  al.,  '/"^ 
ence  on  the  normative  f^J-fi^if^Jg^iSS  structures  that  can  be  estab- 
may  constrain  the  types  ■S?iT"i982)  .    Similarly,  community 

;^,r.nt"„  ri^*^-™i?r'toS=h.oi  1^^^-. 

:xn  research,  it  is  Ley.  "-"•JV  ^^.fcUreUfr of^'U^lT^rl. 
student  backgrouni  "J"  ""??""|  J^%he  way.  Sit  school  Ecosrams  and 
But  it  is  also  i^PO't'l'^J'tSit'iaentical  school  pcograns  ptjduce 
student  inputs  InteiMt  "o  ajSttent  backaroujids.    -mus,  it  is 

Slssi.ilar'^effects  on  »^udent.  fr^different  oa 

i?r.'cttv"^  ror'tslrv^'du:^"st?s^iH^h'lUi^ifi  « 


student  putgQPg^ 


r  several  different  classes       f  "^'f  i»SrSt"'c"aci?Sic"uUs  and 
research  to  consider.    B«?iJ"^f^"^Sici  is  tS2  Uin  goU  of  education, 
attaining  of  academic  ""^U  rf  Lwures  of  personal  developnent  and 
n^^S^.rro•Uh«lMU'•o^^?^cra^  -Jnin,  fs  students  get  older. 

Student  IStJj'utltonlnnii'dJ.iS 
the  Min  acadenic  areas  is  a  f'J"'"^^ "ehools  are  established,  and 
'^ll^^^Ts  S;i"sc^hlSrtr.cSiSish  this  goal. 

..^^T^^^^^'^  ^^^^ 
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higher  order  academic  skills  in  the  major  subjects  such  as 
comprehension,  problem  solving,  expository  writing  and  critical 
thinking.    There  is  some  evidence  of  serious  general  problems  of  school 
effectiveness  on  both  aspects  of  academic  growth  and  developm2nt.  For 
example,  many  local  school  officials  believe  th'iir  basic  skills  test 
score  results  show  a  noticeable  drop- off  in  success  at  grade  5  and  the 
subsequent  middle  grades  that  is  not  well-understood.    At  the  same  time, 
results  from  the  National  Assessment  of  Educational  Proaress  on  recent 
tests  of  mathenatics,  reading  and  writing  suggest  that  improved  perfor- 
mance may  be  especially  evident  on  those  exercised  more  easily  learned 
by  memorization  and  taught  by  rote  drills,  rather  than  on  exercises 
calling  for  more  complex  thinking  and  measuring  the  ability  to  apply 
concepts  to  problem  (solving  (National  Center  for  Education  Statistics, 
1984) . 

pgraonal  devglopmant.    Schools  Bay  h«lp  students  develop  such 
psychosocial  maturity  outcomes  as  growth  in  self-discipline  and  self- 
regulation  supported  by  a  positive  sense  of  self  and  well-developed 
internal  goals,  values,  and  standards. 

In  addition,  one  can  think  of  a  long  diverse  list  of  other  non- 
academic  talents  and  coping  skills  that  are  valuable  to  the  individual 
and  may  be  fostered  in  effective  schools.    These  include  abilities  in 
music  or  the  creative  arts,  leadership  and  interpersonal  skills,  work 
habits  of  industry  and  accomplishment,  and  coping  skills  in  a  variety  of 
organizational  and  social  settings.    Our  scientific  knowledge  is  not 
well- developed  of  the  numerous  human  non-academic  talents  that  are 
needed  and  rewarded  in  adult  life  (e.g.  Coleman,  1980).  Consequently, 
researchers  have  not  usually  tried  to  measure  non-academic  talents  in 
their  studies  of  school  effects  (exceptions  include  the  diverse  check- 
lists of  student  activities  and  accomplishments  regularly  used  on 
National  Merit  and  ACE  surveys  of  college  bound  students). 

Afctaghment  Ifi  ichflftl  .And  flfifid  bghavior.    Bow  students  react  to  their 
school  life  is  an  important  outcome  in  its  own  right  (Epstein,  1983), 
but  it  is  also  instrumental  for  other  school  effects  on  students.  If 
students  are  chronically  absent  because  they  lack  positive  feelings 
toward  the  school,  little  learning  is  likely  to  occur.    If  a  students 
are  frequently  having  serious  disciplinary  problems  with  teachers  and 
school  officials,  the  school  experience  is  not  helping  them  develop  the 
personal  maturity  needed  later  to  successfully  fill  adult  roles  in  work 
and  community  settings. 

Chronic  absenteeism  by  significant  numbers  of  students  occurs  at  the 
secondary  school  level,  especially  in  large  urban  districts.  Serious 
problems  of  violence  and  delinquency  in  school  also  begin  in  the 
middle-school  years. 

Drug  and  alcohol  abuse,  teenage  pregnancy  and  the  tragedy  of  teenage 
suicide  aie  also  serious  problems  where  educational  factors  contribute 
to  their  later  occurence.    He  have  elaborated  elsewhere  how  success  or 
failure  in  school  plays  a  unique  role  in  the  etiology  of  serious  teenage 
problems  (McParUand  and  McDill,  1977). 
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Classrooro  pporatlno  fpnflUiPnSt 

a.ho  t^ird  of  the  four  major  elements  of  the  model  in  Figure  1  is  the 

The  third  of  the                            directlv  affect  student  devtl op- 
group  of  "optating  foj^i^j^j^^  jS  cirssrSoi^ft tings.    We  specify  two 

Sroid  ia^teS  ??;s"f  5ai«?Snpi;ating  conditions:  specific  instruc 
uSmI  practice,  and  the  social  context  of  learning. 

instructional  practices  include  the  ««y  teachers  sign  their 
lessons,  deliver  their  instruction  and  mana^^ 

effective  learning  activities.    A  great  ae«i««  established 

v^iitTc  ^iU^i'i  "I  :??rcti;:'i„rtiEfctir„i!"p..cti=.  m  u.. 

tary  and  middle  grades* 

The  well  context  of  le.tnin.  Include.  "=iSl^?i«"'SUe"^ 
conSJlon.  that  opetet.  Si"f.JSiin"U2r'froup  ptSces^JJ? 

condltiOM  Include  "i!"h2«  Snd  alministt.tocs, 

relations  amonj  cllSateS.    iduMtional  .ociologlBts 

'atUft'S^etrtSfcrsMn  IS^hoSl"? tJ:rifJroer.SS:rhSw  to  t„!n  teachers 
in  effective  instructional  practices. 

context  of  learning. 

Good  (in  press);  Doyle  (in  press). 

Quality  of  instruction  is  the  f,^ir.i%;^jfp,f/te^foS:  seqS-ce!" 
or  skills  are  presented  to  students  in  an  appropriate  tor»j^^^ 

and  pace.    Research  evidence  is  5^"'  ™^^?jifin  the  same  period  of 
oace  of  instruction  moves  through  more  '"teriai  ^'^^^r.^-tent  coverage 
?iSl  wiSSul  sacrificing  student  comprehension.    While  c^ 
is  a  strong  predictor  of  achievement,  J«  ^  JJ^j^JJ  a  f ist^ce  and  a 
interplay  of  classroom  practices  that  maint^^^  on  Reading  1985,  p. 

high  rate  of  8»iccessful  student  mastery  ^^^J^J^^    ^  potentially  under 

fiv'Ssr.rd*?2.''if1.S?«''uie"l£"n!lUi^  lriSltnU%Judent  Lstery. 
The  .pproprlat.  level  o£  in.U«tl.n  i.  the  *9r..  to  which^^ 

&rS-  ^^^^^^^  -Sardii».th 
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teacrer  practices  that  establish  high  quality  instruction,  such  as  the 
frequent  assessment  of  students'  level  o£  mastery  to  link  new  material 
to  previously  learned  concepts  and  to  present  materials  that  students 
can  handle  with  a  high  success  rate.    But  the  appropriate  level  of 
instruction  is  also  affected  by  the  way  students  are  grouped,  whether 
whole-class,  subgroup  or  individualised  instruction.    Again,  researchers 
disagree  about  the  efficacy  of  ability-grouping  practices  and  the  mJn? 
Iti^d  w^JSheJf  "•"■cement  and  notivitioS  it  using  various  indivi"- 

5" Jf*'"}"«      the  degree  to  tfhich  students  are  motivated 
to  work  on  instructional  tasks  and  to  retain  what  is  taught.  Student 
motivation  has  been  a  aajor  topic  in  educational  psychology  over  the 

In^  Ll^  fSLf*  W!^'**^  •  nii»ber  of  diffSint  diScSSSs  (Les 

and  Ames,  If «4) .    The  sources  of  student  sjotivation  are  many,  but  they 
usually  include  elements  potentially  under  the  control  of  the  classroim 
teacher,  especially  In  terms  of  bow  student  perforaancts  aro  Utd  to 
formal  and  informal  evaluations  and  rewards  (Matriello  and  Dornbush, 
1984).    We  now  understand  some  useful  motivational  principles  of 
incentive  systems,  especially  related  to  the  frequency  and  accessibility 
of  valued  rewards,  and  can  incorporate  these  principles  into  teachers' 
classroom  practica  (Slavin,- 1984) .    But,  except  for  research  on  group 
incentives  In  the  classroom  and  the  use  of  home-based  reinforcers,  there 
has  been  little  scientific  study  of  alternative  classroom  evaluation  and 
incentive  systems  as  they  affect  student  aotivation  and  learning. 

Time  for  learning  is  the  degree  to  which  students  are  given  adequate 
time  to  learn  what  is  Uught.    More  time  does  not  directly  aqual  more 
laarning,  but  aora  time  in  high  quality  instruction  that  is  at  the 
students'  appropriata  instructional  levels  will  pcoduea  sore  learning. 
It  is  the   engaged  time,"  when  a  student  is  productively  involved  in 
aporopriate  learning  tasks,  that  matters.    This  depends  upon  the 
allocated  time  (dus  the  teachers*  skill  in  managing  the  class.  Effec- 
tive classroom  wmagement  will  adnimiza  discipline  pcoblans  and  will 
minimise  disruptions  to  learning  activities  from  discipline  problems 
that  do  arise.  Skilled  teachers  will  have  efficient  routines  for 
managing  potentially  time-wasting  chores  that  can  accompany  instruc- 
tional activities  (Xazweit,  1983,  1984). 


Social  ffintAXt  £f  Itftinlng.    Effective  schools  also  include  key 
elements  of  classroom  processes  that  may  not  be  so  directly  under  the 
control  of  a  classroom  teacher  as  the  components  of  instructional 
practice  just  described.    These  elements  include,  among  others,  the 
interpersonal  relationships  that  occur  among  students  and  adults  in  the 
classroom,  and  the  social  climates  that  develop  to  produce  different 
reputations  and  expectaUons  for  performance.  The  interpersonal  aspects 
of  learning  environments  have  received  special  attention  from  many 
•ducators  seeking  to  create  schools  that  meet  the  developnental  needs  of 
their  students  (e.g.    Lipsits,  1985;  Alexander  and  GeorgeV  1981),  but 
few  arrangements  for  changing  interpersonal  relations  of  students  and 
teachers  have  been  carefully  evaluated. 


o 

ERIC 


301311 


ERIC 


For  txunplt,  Mny  critics  of  traditional  junior-high  achoola  focus  on 
ttachar-atudtnt  rtlationahips  aa  a  aionificant  problem  in  tbtat  achooli 
ntt  'ikiddlt  achool  Mve&tnt*  dtvtlopad  in  part  aa  a  reaction  against 
fornalised  teacber-atudent  relationahips  found  in  iunior-high  achool s, 
vhich  were  aeen  at  an  outcoae  of  a»deling  inatruction  for  intermediate 
grade  atudenta  or.  similar  atructurea  uaed  in  senior  high  schools. 
Instead  of  the  typical  secondary  school's  "subject-matter  orientation" 
that  emphaaises  teacher  expertiae  in  a  curriculum  specialty,  a  "pupil- 
oriented"  emrironment  waa  called  for  to  permit  a  doaer  teacher-atudtnt 
relationahip  to  foater  student  personal  developnent.    The  early  adoles- 
cent is  moving  toward  more  self- regulation  and  autonomy  during  this 
period  but,  according  to  this  view,  still  needs  close  personal  contact 
with  at  least  one  adult  in  the  sdiool  to  support  this  growth.  These 
more  personalised  and  auperviaed  teacher-student  relatione  reflect 
typical  elementary  school  practices,  but  advocatea  of  thia  poaition 
expect  teachers  to  also  meet  young  adolescent  needs  for  independence  and 
self-direction.    Little  research  exiata  on  the  d^ynamica  of  adult-atudent 
relationships  that  work  well  for  the  peraonal  development  of  young 
adolescents  who  are  at  different  stages  of  self-reliance. 

Teacher-to-teacher  relationships  are  also  important  aapecta  of  the 
learning  environment.    The  inatructional  flexibility  needed  to  meet  the 
diverse  needs  of  students  depends  upon  teaehera  cooperating  with  one 
another.    Haqy  educators  advocate  creating  teams  of  teachers  to  work 
with  shared  student  groups.    Tbw  reaaon  that  teams  can  (1)  more 
correctly  diagnose  individual  neids  and   Uilor  learning  experiences  to 
meet  thoae  needs y  and  (2)  more  creatively  develop  lively  learning  i 
activities  that  will  appeal  to  children's  and  adoleacents*  senae  of 
action,  fun,  and  fantasy*  vhich  will  better  hold  their  attention  and 
promote  enthusiastic  effort. 

Advocatea  of  teachers  working  as  teams  expect  greater  coordination  of 
learning  activities  across  formal  subjects,    ■owever,  no  reseat: ch  haa 
carefully  and  scientifically  compared  the  actual  advantages  of  different 
uaea  of  teaching  teama  with  the  possible  disadvantagea  that  may  occur  if 
individual  teachers  do  not  get  along,  do  not  share  common  educational 
viewa,  or  do  not  effectively  use  common  time  to  diagnoae  atudent  needs 
and  coordinate  instructional  responses. 

Relationahips  among  students  in  peer  groups  alao  can  greatly  influ- 
ence the  kind  of  learning  environment  that  ia  created.    Peer  aupport  ia 
highly  valued  in  the  growing  up  process  for  most  young  people,  but  the 
peer  influences  can  vary  greatly  in  strength  and  direction  for  different 
individual a. 

Which  atudenta  an  individual  aasociates  with  may  have  a  powerful 
effect  on  personal  development,    low  many  paer  groupa  and  doae  friends 
an  individual  is  attached  to  may  determine  how  influential  any  parti- 
cular circle  of  frienda  may  be.    The  everlapa  among  a  student's  associ- 
atea  in  daas,  in  axtra-curricular  activitiea,  and  outside  of  school  may 
alao  influence  peer  group  effeeta.    Some  reaearch  haa  examined  theae 
topica  (Epatein  and  Karweit,  IflS)?  but  much  more  needa  to  be  learned 
about  how  to  coordinate  the  foreea  of  the  peer  group  to  help  atudenta 
achieve  academic  and  developmental  goal a. 
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.ffl^t-^    V  ^thos  of  a  school  is  also  important  to  an 

effective  learning  environment.    This  factor  includes  the  aoals  anS 
normative  expectations  for  behavior  that  develoD  in  the  Lho^T 
ulitnV'  "f"'!"lon  or  i"age  that  can  influeLe  hoj  an  indiiidSl""' 

^^Ti^^^J^i^  Se1t%2^5?h-anlXr^£  Of 
s^%r^:^s"ol°lL=de^J?s^aSr^l^ih°2?;/"  '''''  an^co^ifr^t^r^lor 

«.h^il'c°^?^  ^^'^u       agreement  among  researchers  that  more  effective 
schools  stand  out  from  others  in  their  educational  climates  how 
different  climates  develop  in  schools  that  enroll  similar  studpnt 
populations  is  not  well  understood.  similar  student 

^ShQiil  oraanizahif>n  ^  policy. 

To  reliably  create  appropriate  instructional  practices  and  learnina 
environments  in  schools,  we  need  to  understand  how  classro^  onfr^H^^ 
conditions  depend  upon  the  enabling  and  suppSrt  s?rSc?ures^-  ^ 
organization  of  the  school  and  its  administ^ativf^licIIL  T^ele 
school  organizational  and  policy  variables  include  schoorkze?  curric- 
ulum policies,  staffing  patterns  and  roles,  grouping  of  students  for 
instruction,  scheduling,  student  moitoring  a?d  e?alua?ion  proSedufes 
opportunities  for  student  accomplishment,  and  grade-span?  P''^''^^""^' 

PolIcv^ac'^oJr  Jr^rl;^?^!  °"  ^'^^^^  organizational  and 

policy  tac4.ors,  it  is  helpful  to  compare  the  "tvcical"  elPmpnt-;,rTr  »r^A 

secondary  school.    Data  should  be  collected  on  the^ctuS  Si s^?Ibut?on 
]  classroom  practice%a??ors  S'e^uSuonar" 

level,  since  no  reliable  national  data  now  exists  on  these  matters  For 
^Sh\?^h'^"^k^°?',^^  y^^^  speculate  on  the  differences  bl?Seen  e?em;ntI?i 

?Sese^Ixtr'^es    ^7."il\^^''J  '°2f^'"  'Z'"'  possibilUi'ls  S?Se2n"^ 

cnese  extremes.    We  will  also  discuss  how  each  oraanizationai  anH  nnH/^, 

component  may  affect  instructional  practid  or  ?eI?Sinf  en?iroJSents 
what  major  research  now  exists  on  these  effects.    Sbll  1  waf  S^e^red 
to  accompany  these  discussions.  prepared 

strf^ff^i  potentially  important  element  of  school 

structure  at  all  levels  because  the  number  of  students  in  a  school  can 
affect  (a)  student-teacher  relations,  (b)  relationl  bltieeS  feacherf  2nd 

iJ?ivUie"       ^^^^5^^"^^         participation  in  extra-curricula? 

Large  schools  may  reduce  the  chances  for  positive  student-teacher 
interactions,  by  making  it  less  likely  that  ItudenH  will  ?eel  closelv 
supervised  by  teachers  or  that  each  student  will  develop  a  close  ^ 

SclL°??ind"ind'SSDi??  ^^^^f"  ""."^^  schiol  (GfrCLLS'MvS; 

McPartland  and  McDill,  1977) .     Compared  to  a  small  school  where  most 

tr-glJ'lSs^t^i'ii'JSf^"  ^^^^^^  ^  is  morri  kely 

to    get  lost    in  the  depersonalized  environment  of  a  large  school. 
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Table  1 


SCHOOL  orga:jization  and  policy  of 

TYPICAL  ELEM£NT.\KY  SCHOOL  AND  TYPICAL  HIGH  SCHOOL 


SCHOOL  ORGANIZATION 
OR  POLICY  


"TYPICAL" 
ELEMENTARY  SCHOOL 


Si  ▼e 

Curriculum 

Staffing  assigniTients  and 
roles 

a.  nuc;fcer  of  different 
students  per  teacher 
in  a  typical  week, 

b.  number  of  different 
subjects  taught  per 
teacher 

c.  number  of  different 
teachers  per  student 

d.  Principal's  role 

e.  Advisory/ guidance  role 


4,      Grouping  of  students  for 
instruction 
a,  homogeneous  groups 


b,  low-achieving  students 


Small 

basic  skills,  required  courses 
courses 


one  class  (20-30  students) 
"self-contained  classroom" 


all  major  subjects  in  the 
grades 


one 


instructional  leader 

classroom  teacher  assumes 
responsibility  for  diagnosing 
student  needs  and  providing 
or  funding  assistance 


within-class  ability  grouping 


corrective  instruction  within 
class 


(  CD 


"TYPICAL" 
HIGH  SCHOOL 


Large 

higher  order  skills , 
some  electives 


several  classes 

(100  or  more  students) 


>• 

o 

CD 


one  subject-matter  specialty 
"departmentalized" 


several 


school  manager 

students  are  more  responsi- 
ble for  seeking  help  when 
needed;  adult  guidance 
specialists  are  provided 


( 


tracking  and  program 
differentiation  (between- 
class  grouping) 

separate  remedial  classes 
special  teachers 


Schedul ing 

a.  'i'lme-schedule 


b.  student- schedule 


c.  required/elective 
courses,  classwork 


flexible  timing  under  control 
of  teacher 

intact  classes  of  students 
remain  together  (self-contained 
classiTOom  or  block  schedule) 

courses  are  required,  teacher 
assigns  classwork 


fixed  schedule  of  periods  as 
students  change  classes 

students  regroup  for  each 
period  as  they  change  classes 


combination  of  requirements 
and  student  electives  of 
courses  and  classwork  from 
teacher  defined  alternatives ^ 
occassional  independent  study 


6.      Monitoring  and  evaluating 
students 

a,  grading  practices 


b,  discipline 


7,      Opportunities  for  stude 
accomnl ishment 


balaince  positive  evaluation 
for  both  student  performance 
and  effort. 

classroom  variations  in 
discipline  management  are 
permitted  within  school 
rules  and  procedures 
(personal  authority) 

limited  or  no  extra-curricu- 
lar activities 
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evaluations  based  on  perform- 
ance compaxisons 


school-wide  rules,  code* 
and  procedures  are  in  force' 
(bureaucratic  authority) 


extensive  program  of  clubs, 
teams  and  activities 


According  to  this  view,  students  will  more  often  be  left  to  their  own 
unsupervised  activities  in  the  anonymity  of  large  schools. 

Administrative  practices  are  more  likely  in  large  schools  to  rely  on 
bureaucratic  processes,  such  as  reliance  on  standard  rules  and  regula- 
governing  teacher  and  student  behavior.    Relations  be"een 

Idtir  moJjfiMJJ^.''*  more  impersonal  and  inflexible,  which  can 
create  lower  morale  and  an  unwillingness  by  the  staff  to  respond  in 
innovative  ways  to  problems  (Garbarino,  19?8).    According"o^h?s  view. 
i3J!f!f'  ff'^ooi"  communication  among  staff  is  more  difficult,  school 
administration  is  more  cumbersome,  cooperation  between  faculti  and 
adminstration  In  planning  and  implementing  new  programs  is  reduced,  and 
clear  wel.i -understood  policies  are  less  likely.    Some  research  does  show 
smaller  school  size  to  be  related  to  teachers'  positive  per^eptiSnl  of 
school  administration  (Ebert,  Kehoe  and  Stone,  K84;  Gottf  redfonri985) , 
Zt^  absence  of  attendance  problems  among  teachers  (Winkler,  1980)  and 

inH'^!;??y'"''*,S?2^"?!2*^  activities  among  the  teaching  staff  (Bridges 
and  Hallinan,  1978;  Bridges  and  Hallinan,  1978).  ^o^-ioges 

Smaller  schools  may  also  produce  different  peer  groupings  of  student" 
because  extra-curricular  offerings  and  trackinrpralticis  are  affecteS 
«h«i5*«.;ii*«?!ii^!  Kli?*"^?*'^^:    Research  at  the  high  school  level  has 

?™f'  f  f^^  schools  often  induce  a  higher  percentage  of  students  to 
get  involved  in  extracurricular  activities  (Baiid,  1969;  Barker  and 
Gump,  1964,  Grabe,  1981,  Kl.inert,  1969;  Wicker,  1969),  which  in  turn 
connects  the  average  student  to  a  more  diverse  personal  network  of 

The  track  levels  in  a  nail  school  nay  also  expose  each  student  to  a 
more  diverse  set  of  peers  than  would  occur  in  a  large  school  with  the 
If^L"2^!  ^  atudent  body.    A  large  school  that  tracks 

according  to  test  scores  or  previous  academic  achievement  will 
""i  w??f*  homogeneous  classes  with  greater  differences  between 
the  top  and  bottom  classes  in  student  abilities  than  will  be  found  in  a 

SI;n-!^5?!^  ''^Jf        f^t  ""3*       atudent  abilities.    This  occurs 
because  the  mall  school  have  fewer  sections  of  each  course,  so  each 

I*  '^^.fi®!*'-*''®  ^*  students  in  the  school  at  large. 

S*!"  ^•fy  ^•'^y  students  in  a  smaller 

f f  J!    to  be  tssigned  to  exclusive  classes.    Thus,  when  the  student  mix 

iSrJ?Inf?°°^.f*iff°"'  ^*  schools,  extra- 

f  ■fJ^''^'^*?        tracking  will  often  produce  more  diverse  peer 
contacts  In  the  nailer  schools. 

On  the  other  hand,  larger  schools  will  ordinarily  draw  from  a  larger 
and  more  diverse  attendance  area,  so  the  student  body  as  a  whole  is 
likely  to  be  more  heterogeneous  by  family  background,  race  and  other 
characteristics.    Whether  an  individual  student  in  a  large  school  will 
actually  come  into  contact  with  peers  from  different  backgrounds  depends 

school  policies  concerning  tracking  and  extra-curricular 
JJ:  Iiii*f*  direct  research  is  needed  on  how  school  size  changes 

the  opportunities  for  diverse  peer  contacts  and  the  actual  formation  of 
peer  groups. 
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Large  schools  may  have  some  advantages  In  variety  and  quality  of 
curriculum  offerings  (Conant,  1969) .  A  large  school  is  more  likely  to 
have  enough  students  interested  in  certain  unusal  courses  —  such  as 
some  foreign  languages*  technical  courseSf  or  advanced  level  offerim^s 
—  to  justify  the  expense  of  staff  and  equipment  to  provide  these 
courses. 

Sane  structures  nay  offset  tht  disadvantages  of  tht  imoersonality  of 
large  schools  by  cctating  mailer  idtntifiable  units  within  a  section  of 
the  same  building t  a  "school-within-a-ftchool. *    In  these  lubgroupsf 
teacher  and  student  assignments  and  activities  cn^asizt  identification 
with  the  Bnalltr  unit  and  its  members.    Educators  have  suggested  various 
ideas  about  how  to  conduct  activities  with  and  between  different 
subunits  of  a  large  school  to  achieve  good  interpersonal  relations  and 
student  attachment.    Little  careful  research  has  been  conducted  on  these 
issues. 


staffing  patterns  and  rolea?    Elementary  school  teachert  are  usually 
assigned  to  a  self-contained  classroom  where  a  single  teacher  is  in 
charge  of  instruction  in  all  'major  subjects  for  an  intact  dris  of 
students.    High  school  teachers  usually  are  'depaitnentalized*  by 
subject-matter  area,  and  assigned  to  teach  courses  in  one  specialty  area 
of  t^.e  curriculum  to  different  classes  of  students  during  the  school  day 
and  school  week.  Teacher  certification  regulations  in  most  states 
reflect  this  differencei    Teacheri  are  certified  by  level  at  the 
elementary  grades  without  subject-area  distinction  while  teachers  are  ^ 
certified  by  subject-matter  specialties  at  the  high  school  grades. 

Thus  the  typical  tleBentary  sciiool  student  receives  almost  axl 
instruction  from  one  home-room  teacher,  while  the  typical  high  school 
student  receives  Instruction  from  several  different  teachers.    And  each 
elementary  teacher  is  responsible  for  a  single  class  of  20  to  30 
students  but  must  prepare  lessons  in  a  number  of  subjects,  trtiile  each 
high  school  teacher  may  see  well  over  ICO  students  in  a  given  week  but 
can  concentrate  on  teaching  in  one  curriculum  specialty. 

Both  the  high  school  and  elementary  modes  of  staffing  offer  advan- 
tages and  disadvantages.    Departmentalisation  and  subject-matter 
orientations  may  increase  the  quality  of  instruction  by  allowing 
teachers  to  increase  their  competence  in  a  curriculum  speciality, 
provide  outstanding  learning  activities  for  a  limited  nunber  of  separate 
daily  preparations,  and  bring  a  special  enthusiasm  to  particular  areas 
of  the  curriculum  that  is  sustained  by  departmental  colleagues.    On  the 
other  hand,  the  self-contained  classroom  of  the  elementary  grades  is 
believed  to  achieve  strong  "pupil-orientation*  due  to  the  close  and 
concentrated  associations  between  a  s.fngle  teacher  and  a  fixed  small 
group  of  students. 

Various  structures  have  been  proposed  to  strike  a  balance  between 
these  two  poles  —  to  achieve  a  personalized  learning  environjnent  while 
allowing  individual  teachers  to  develop  high  quality  curriculum  special 
ties.    These  include  a  variety  of  teacher  team  arrangements,  such  as 
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special  roles  for  the  homeroom  advisor  in  a  modified-departjnental ized 
school.     (See,  for  example,  Alexander  and  George,  1981,  Chapters  4  and 
5.)    For  example,  a  team  of  two  or  three  teachers  could  serve  50  to  75 
students,  with  each  teacher  specializing  in  a  broad  curriculum  area  such 
as  math  and  science  or  language  arts  and  social  studies.    The  team  would 
work  together  to  diagnose  student  needs,  establish  student  instructional 
groups,  and  coordinate  and  schedule  learning  activities.    Provision  for 
team  planning  time  would  be  built  into  the  weekly  schedule.  Another 
example  would  be  to  have  larger  teams  of  subject-matter  specialists  (5 
or  6)  serve  larger  common  groups  of  students,  but  also  provide  a 
personalized  guidance  program  in  which  each  student  is  assigned  to  one 
particular  teacher  in  an  ad^'isor-advisee  capacity. 

Although  creating  teacher  teams  with  scheduled  time  to  diagnose 
students  and  plan  instruction  would  seem  to  be  a  way  to  achieve  desi- 
rable instructional  practices  and  interpersonal  environments,  there  is 
no  guarantee  these  opportunities  will  be  taken  advantage  of  by  teachers. 
How  much  does  the ^success  of  teacher  teams  depend  upon  how  well  team 
members  like  each  another,  on  how  the  use  of  team  planning  time  is 
supervised,  on  the  roles  defined  within  the  team,  or  other  operational 
factors?    Research  has  not  carefully  investigated  these  questions,  or 
other  issues  related  to  staffing  patterns  and  the  effectiveness  of  the 
resulting  learning  environments  and  instructional  practices.    We  do  not 
ever!  have  good  descriptive  statistics  on  the  use  by  schools  of  different 
staffing  patterns  at  the  elementary,  middle  and  secondary  levels. 

The  role  of  the  prinelpal  is  another  key  issue  of  staff  roles  vhere 
interesting  comparisons  have  been  made  between  elementary  and  high 
schools  (Farrar,  Neufeld  &  Miles,  1984;  Firestone  &  Berriott,  1982; 
Purkey  &  Smith,  1985}.  The  elementary  principal  is  more  frequently  seen 
primarily  as  an  instructional  leader  (assisting  and  evaluating  indivi- 
dual classroom  teachers;  establishing  the  school  climate).    The  high 
school  principal  Is  more  frequently  seen  primarily  in  an  adminsistrative 
or  bureaucratic  role,  %ri)o  helps  maintain  priorities  on  learning,  is  in 
charge  of  the  rules  and  their  enforcement,  and  involves  teachers 
appropriately  in  decisions  on  school*wide  matters. 


Grouping  students  for  instruetlont    Elementary  schools  are  more 
likely  to  randomly  assign  students  to  classes  but  to  group  students 
within  the  classroom  for  instruction.    Hithin-class  ability  grouping 
usually  involves  creating  three  homogeneous  groups  of  students  who  have 
similar  current  levels  of  achievement.    Within-class  ability  grouping  in 
elementary  school  rooms  is  almost  always  used  in  reading  instruction  and 
is  often  used  in  math  instruction.  (Peterson,  Wilkinson  and  Ballinanr 
1984) . 

In  contrast  to  elementary  schools,  high  schools  create  more  homoge- 
neous instructional  groups  by  placing  students  in  programs  and  tracks  by 
achievement  level.    High  schools  separate  students  according  to  entire 
programs       such  as  academic  or  college  preparatory,  general,  vocational 
or  technical,  and  commercial  or  business  —  and  according  to  course 
track  level  within  the  program       such  as  high,  medium,  and  low  sections 
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of  English  cours.8  at  the  «an>e  grade.    Because  students  are  -.aced  into 
Separate  progran.s  and  courses  hy  fchievement  levels,  there  is  rarely  an 
within-class  ability  grouping  at  the  high  school  level. 

bi«h  »ehool»  wpant*  f"»f*i*i„?;!fl?  *"2  SdetS  .upport  (Title  1  «nd 

SJ!  o5t  1«  «hl.».r«  fte.  thSr  t.,ul.r  cl..«ooi..  for  .p.ci.1 

instiuct' on. 

otouping  ptaetlc»»  5>«»«  betn  pcovtd  to  »«»•  •  iJ»    h,c»u«.  there 

teiearcb  mi»t  vn  ipcelal  •ttentfon  to  how  actiiu  ei»»»Eo«»  i"" 
i"  •dSptIa  toTiffiiont  iMttntloMl  grouping!. 

A.  rentreb  thottld  onalM  aetillofl  pr«ctle»t  within  »«}»"• 
.«b*;up"«S  .."bUri,  eonvlneln,  "l"""?  iSnlS^Mjh 
:tuS.nt'dlff.r.nc...    ....nt  J^JJI^^^^ 

Bouelt  ot  41,  1914) 

Khil.  tb.t.  1.  .uch  oon^niu.  .bout  9"»Pj?«  P'ff  tSIVwaJi'^Md'?' 

s::/;rsir..r:5JMuSn:n?'r.ntr;n:ri'pi*inrLs..ht^  bc.  * 


<1>   N.  a»  .uopect  th.r.  1.  "io'lty  irU^Mn.?;?'"  K"Sldirt''tt.'t''J 
.£f»et.  .£  grouping,  b"*  ""J  »  »g?f"Uu2f  tt.?  ho-SJeSSui  groupl- 
;?^Ui?.„t"'pr"oS?c.".V"«"i«"K«lS*Ur.i*'in2ncJrori.  t.r,ete.  to 

Student s'  currant  needs. 
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middle-school  grouping  practices  depend  upon  the  subj ect-rr.atter  area  cf 
the  course  and  the  staffing  patterns  in  use?    How  do  intermediate  grade 
teachers  adapt  their  instructional  practices  to  the  needs  of  each  group, 
including  provision  for  student  initiative  in  learning  tasks?  What 
relationships  between  students  and  teachers  and  among  students  develop 
with  different  instructional  grouping  arrangements?    what  student 
outcomes  are  more  likely  to  occur  when  alternative  grouping  structures 
are  coupled  with  particular  classroom  practices? 

The  opportunities  created  by  alternative  instructional  groupings  for 
more  efficient  instruction  depend  upon  the  actual  tasks  established  in 
the  classroom  (Bossert,  Barnett  and  Filby,  1964;  Bossert  and  Barnett, 
1981;  Bossert,  1979).    Bossert* s  analyses  of  how  within*class  ability 
grouping  may  be  associated  with  a  variety  of  actual  classro^  practices 
can  be  extended  to  questions  of  how  between-class  grouping  level  may 
foster  different  instructional  management  and  learning  environments 
within  the  classroom.    The  goal  of  this  research  is  to  show  how  the 
positive  effects  of  particular  grouping  policies  depend  upon  the  actual 
classroom  practices  that  are  used  to  take  advantage  of  the  policy. 


Scheduling!    The  manner  in  which  school  schedules  are  made# 
—dividing  the  school  day  into  different  periods  for  instruction  in 
separate  courses  and  assigning  teachers  and  students  to  different 
classroom  locations  during  the  day       is  closely  related  to  the  deci* 
sions  on  staffing  and  instructional  grouping  we  have  discussed. 

In  elementary  schools,  the  teacher  in  a  self-contained  classroom 
usually  schedules  the  nix  of  time  devoted  t;o  each  curriculum  area, 
within  general  guidelines  provided  by  the  school.    There  are  no  fixed 
periods  announced  by  the  ringing  of  bells  throughout  the  day  to  signal 
the  time  for  teachers  of  students  to  change  locations.    Teachers  use 
their  professional  judgment  to  arrange  instructional  activities  of 
different  durations  to  fit  the  changing  demands  of  curriculum  topics  or 
changing  needs  of  students. 

At  the  high  school  level,  the  forms  of  tracking  and  staffing  used 
will  be  related  to  the  type  of  scheduling.    Since  teachers  must  meet 
different  classes  throughout  the  day  and  since  each  student  receives 
instruction  each  day  from  different  teachers,  a  centralized  schedule  is 
necessary  to  divide  the  school  day  into  fixed  periods  of  time  and 
provide  lists  to  locate  where  each  teacher  and  each  student  is  to  be 
each  period  for  instruction  in  specific  courses.    The  change  in  periods 
is  usually  announced  by  the  ringing  of  bells  and  signals  the  movement  of 
t'Lachers  and  students  through  the  school  corridors.  These  regular  sounds 
and  traffic  have  come  to  symbolize  for  some  the  over- regimentation  of 
the  American  high  school. 

The  schedule  may  vary  in  complexity  depending  upon  the  flexibility  of 
instructional  time  periods,  the  variability  of  student  qroups,  and  the 
number  of  elective  courses  permitted,  as  well  as  other  local  compli- 
cating circumstances.    For  example,  a  *block  schedule"  keeps  student 
groups  together  as  intact  classes  for  most  periods  of  the  day  with 
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«2d.nt  to  be  at  several  Ff' J"    „odular  time  units 

so  soroc  courses  can  DC ^  ^ 

instructional  time  on  certain     y  decisions 
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g^Kv-ftuni>jfff  l£i  acdoriplifihrnent;     High  schools  provide  a 

level'  IchIIiI    "rifrl^^^  students  can  oain  recognition  than  do  lower 
level  schools.    Extra-curricular  activities  in  high  schools  permit  Lnv 
individuals  to  develop  and  demonstrate  competence  in  athletils,  in  ^ 
musical  and  artistic  performance,  in  producing  a  school  newsM^^  er 
yearbook  on  some  publication  outlet  ffr  creaJivJ  waiting,  iS^SkinS 

^iinf'iS'as'sum^iSj^Sili'?*"  '•S?^"  organization:!  iid'lnter^  sinfl 
Siitical  s?i??S        f,^l^?"""*i-?5       representative  roles  where 
political  skills  are  useful,  and  in  enjoying  a  variety  of  soecial 
interest  and  hobby  activities  where  indKiduals  Jn  SvSop^ique 

ijn^iSf^J  ?J  y*f^°"  '•^^^'^  °"  high  schools  have^c^lUd  for 

expanding  the  opportunities  for  students  to  assume  initiative  and 

"l?^?'S1i3^^Co?J?^rS'J??  ^S'^^^"*^  their  commJn??y 

iBoyer,  1983»  Coleman,  1974;  Newmann,  1981). 

•  wide  range  of  opportunities  for  accomplishment  is  also 
vital  for  middle-schorl  .tudents,  because  early  adolescence  Is  a  time  of 
striving  for  achievanent  and  competence.    To  divelop  a  positive  self- 
concept  and  to  mature  in  self-confidence,  young  adolescents  need  to 
develop  general  abilities  to  function  .ucc^ssfSlly  i"a  J^iS"  of 
situations  and  expand  the  particular  talents  that  bring  Sem  sLIial 
pleasure  or  accomplishment..  Bi*^iaa 

To  identify  ways  to  provide  nore  opportunities  for  student  accom- 
plishment,  research  is  needed  on  both  (a)  how  to  make  rewards  for 

f^ldf^rJJal  of students,  and  (b)  how  to  provide 
a  iLlJlfil  XAnafi  of  activities  that  require  and  recognlie  a  diversity  of 

SSSrJj^ISif-  .r°'  question,  «•  need  to  study  alternative 

academic  avaluatlon  systwns  that  are  responsive  to  individual  effort, 
improvements  In  performance,  or  alternative  nodes  of  demonstrating 
competence.    Por  the  second  Question,       need  to  identify  a  wide  range 

I?fS!:f«^«n^li'/°:*'S"\'^"^"  •"'^  ■•'^^^  activltlei  and  evaluate 
:2    1  5^^*^^*  °2  student  development  and  self  image  to  provide  a 

JjJoijfflK?*"!  f®''  Mpanding  the  range  of  opportunities  for  student 
accomplishment  in  schools. 
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Sf?  !Z°?iI^.^*f!L^f  •  organizational  question  that  must 

fj.  !i«     the  district  level  rather  than  approached  within  each  school: 

Kl*'*  structure  of  gride- span  organizations  for  schooling 
Children  between  ages  5  and  17. 

or  5?L!f*"F^*'  ^^Vl        P"'>*bly  been  more  written  on  the  advantages 
« Jij^fS  f2!f  °f  grade-span  structures  for  the  Intermediate 

H^tt    ^'i'h  less  clear  research  guidance  than  any  other  single  topic 

"83,  the  Educational  Research 
f fS^  o?  iKJ^i^SSfi^**"*?  •  200-P*9«  ■uttoary  of  research  on  tht  organiza- 
iinl^Jj  "»*^        separate  references.  Pe3 

I    ?J*.^^"S^!!P  «n"9f<5  «rom  the  review.    The  ERS  conclusion  that 
or«n?^!irS.?^  program  is  nore  inporUnt  than  grade  level 

organizations-  echoes  our  view  that  structural  features  such  as  grade- 

f?J?rnif4i"^'^'*"\?"^y  ^^'f  or  support  those 

i?n^i^f  in;'^L^*''*'^'^*  and  learning  environments  that  produce  desirable 
Student  outconeSe 
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we  believe  further' research  is  warranted  on  how  alternative  grade- 
span  itructurei  »ay  be  related  to  initructional  practice,  learning 
environments  and  important  ittudent  outcomes. 

Pirit,  past  research  on  these  issues  has  usually  not  applied  careful 
statistical  controls  on  differences  in  student  inputs.    Second,  there  as 
a  reasonable  basis  to  think  that  grade-span  may  directly  affect  some 
variables,  especially  peer  group  environments  and  their  consequences. 
For  example,  advocates  of  the  6-8  grade-span  argue  that  ninth  graders 
are  much  closer  developnentally  to  tenth  graders  than  to  eighth  graders, 
and  a  less  desirable  (Hoo  sophisticated")  environment  is  produced  when 
ninth  graders  are  left  in  the  same  school  with  younger  adolescent*  and 
pre-adolescents.    More  careful  research  is  needed  on  peer  group  refer- 
ence groups  and  educational  climates  in  schools  with  different  grade- 
spans  (Blyth,  Hill  and  Ssyth,  1981). 

Third,  a  small  number  of  veil-designed  studies  find  impressive 
effects  of  schools  with  different  grade  spans  on  good  school  attendance 
(Slavin  and  Karweit,  1982)  and  self-esteem  (Blyth,  Simmons  and  Bush, 

1978) . 

Fourth,  other  grade- spin  sequences  may  deserve  careful  examination 
for  their  support  of  learning  environments  that  are  well  suited  to  the 
needs  of  young  adolescents.    The  Uaditional  two-stage  1-8  elementary 
and  9-a2  secondary  school  structure  should  be  carefully  studied  —  it 
remains  the  modal  pattern  today  among  private  schools. 

21^  A  i2fill9r>  lai  Rea^areh 


fioi  e  General  J2fiAi9D  CftlUlidegltiQng 

The  model  presented  in  the  previous  section  is  a  «>»Pr??»*n»i^*  .  . 
account  of  instructional  snd  organisational  "iJ*  fiJ 

school  districts  that  are  likely  to  have  important 
student  academic  achievement,  personal  growth,  and  ^. 
attitudes  and  social  behavior.    As  such,  a  •in9l«  ,P^i;Si 
research  design  could  never  adequately  measure  and  test  all  of  the 
parameters  and  Iq^potheses  in  the  model. 

A  mixture  of  research  designs  and  projects  is  cl»;fly.?«*Jf,J- 
appropriate  mixture  would  include  systematic  ob-jrvational  studies,  so 
that  *dense'  measurements  can  be  made  where 

questions  would  produce  severe  distortion.    It  would  include  "P««ted 
measurements  on  So  same  students  over  aany  years,  so  that  longer  term 
SSSSSS  Sf  schooling  cculd  be  followed.    AnS  it  would  include  using 
multiple  instruments  and  multiple  respondents  at  the  same  JUJ' .J®^"^". 
speSE  expertise  and  complementary  perspectives  would  contribute  to  the 
final  information  product. 
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Yet  It  would  also  be  useful  for  the  multiple  projects  and  designs  to 
build  upon  one  another,  using  the  same  sample  of  schools  and  students, 
and  the  same  theoretical  frajnework,  so  that  each  project  could  gather 
data  not  only  to  answer  questions  that  it  posed  but  so  that  it  could 
inform  regaining  projects  in  the  series,  avoid  duplicative  data  gath- 
ering, and  optimise  the  data  collection  method  to  the  kinds  of  informa- 
tion needed. 

Particular  research  questions  drawn  from  the  common  theoretical 
framework  may  require  specific  variations  in  a  common  study  design. 
However,  following  the  model's  emphasis  on  school  and  dessroom  factors 
as  independent  or  "treatment"  variables  and  student  academic  perfor- 
mance, personal  development,  and  school-related  attitudes  and  behavior 
as  outcome  variables,  we  see  the  following  as  general  considerations 
that  should  be  followed  for  much  of  the  research  that  is  needed. 

First,  the  analytic  unit  to  most  of  the  specific  studies  should  be 
the  .&£M£l  or  the  classroom,  not  the  individual  student.    Where  the 
concern  is  with  school-level  policies  that  affect  instruction  and 
learning,  such  as  between-class  ability-grouping,  or  departffient2di2ation 
of  the  teaching  staff,-  the  unit  of  analysis  is  the  school.  Where 
classroom  instructional  practices  are  the  concern,  the  unit  of  analysis 
is  the  individual  classroom.    Even  where  long-term  outcomes  are  the 
issue,  the  students  followed  over  a  several  year  period  continue  to  be 
valid  measurement  points  for  the  study  of  the  consequences  of  school 
orjanizatipnal  or  classroom  instructional  treatments.  Longitudinal 
student  data  is  merely  the  means,  by  which  appropriate  data  is  gathered 
to  study  the  effectiveness  of  school  and  classroom  practices  and 
conditions. 

Secondly,  it  is  also  appropriate  that  the  sampling  unit  be  the  school 
and  sub-samples  of  its  classroom  groupings  (e.g.,  5th  period,  room  120, 
Monday)  .    Again,  the  student-based  survey  instrumentr*  are  a  means  of 
obtaining  measures  of  the  effect  of  the  classroom  treatment,  whether 
this  be  the  grading  and  incentive  practices  of  the  teacher  or  practices 
of  school -home  cooperation. 

Third,  measurements  of  school  policy  and  classroom  practice  need  to 
be  made  at  appropriate  points  and  with  sufficient  investment  so  that 
measuronent  error  on  individual  cases  is  reduced  to  a  manageable  point. 
Asking  teachers  or  school  administrators  to  describe  policies  will  be 
generally  accurate  if  those  policies  are  conscious,  public,  stable,  and 
explicit.    The  more  that  questions  deal  with  behavior  patterns  deter- 
mined by  custom,  internal  politics,  or  general  agreement,  and  the  more 
that  the  pacterns  vary  according  to  the  characteristics  of  the  specific 
instance,  the  more  that  attention  ba i  to  be  paid  to  obtaining  multiple 
sources  of  data  about  the  factor  in  c^uestion,  measuring  the  t:«havior  or 
policy  at  different  points  during  the  school  year,  and  using  judgments 
of  external  observers  rather  than  relying  solely  on  self-reports  of 
school  practitioners. 

One  of  the  most  important  "givens"  of  school  research  is  that  schools 
and  classrooms  providing  differing  treatments  often  start  .;ith  student 
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gxo'ljs  that  hardly  resemble  one  another.    Thui,  it  is  important  to 
devote  resources  to  measuring  both  the  •starting-  and  the  •njing 
a^-ritutes  of  students  that  may  be  affected  by  the  type  of  school  or 
classroom  treatment  being  provided.    Although  ji^Pl*  - 
survey  designs  have  been  the  norm  for  Host  studies  of  »chool  effects, 
our  understanding  of  the  consequences  of  differential  educational  ^ 
treatments  has  been  immeasurably  harmed  ty  using  -socio-economic-status 
and  other  background  variables  to  stand  in  as  surrogates  *.»r  student 
•Starting-  chafactetistics.    It  is  time  that  all  major  studies  of  school 
practices  be  don*  with  both  -pre-test-  and  -post-test-  points  of 
measuring  student  outcomes,  at  the  very  least. 

Not  only  do  students  have  differing  backgrounds  that  affect  school 
performance  and  attitude,  but  each  student  has  a  prior  history  of  school 
Eperiences  and  •xposurt  to  various  school  and  classroom  f^c^ifj*-  /. 
study  beginning  at  one  point  In  time  should  also.  If  possible,  attend  to 
issues  of  prior  school  experience,  including  gathering  data  about 
previous  teachers  and  previous  schools  attended. 

In  analyzing  the  effects  of  instructional  practices  in  individual 
classrooms,  research  sust  take  into  account  that  in  most  secondary 
schools  and  in  many  elementary  schools,  students  are  taught  in  more  than 
Sne  Sassroon  setting  by  multiple  teachers  applying  different  practices 
?S  differinrways.    Studies  of  tte  impact  of  classroom  PJ*?*}"; 
consider  how  these  simultaneous  multiple  treatments  are  likely  to  affect 
SS  outcome  measures  of  interest.    Often,  it  may  be  valuable  to  obtain 
comparable  survey  instruments  about  classroom  practices  from  sach  ( 
teaSer  in  the  school  who  also  tsa&es  some  of  the  students  who  are  in  - 
the  -sampled-  teacher's  classroom. 

Many  questions  about  ths  consequences  of  schooling  relate  to  student 
adjustment,  attitudes,  and  behavior  in  subsequent  school  .  . 

exoeriences— for  example,  questions  about  how  experience  in  one  school 
IfflctI  itSdenti-  dis?ipiiSry  hsbits,  school  attendance,  snd  school 
SrfSrJaScS  a?  a  subseqSent  iJhool  attended.    Such  ^"••tionj  require 
thit  the  students  be  fSllowed  for  st  least  y;"*  »>i?222aSl  it 

treatment  being  studied.    In  addition,  for  many  " 
may  ba  that  only  consistent  treatment  applied  in  ■"^^•■■i^ 
environments  haS  important  and  r""!L"\?"?^f"?t  'i.  TS^JtlS?  that 
such  ■small,  cumulativa  impacts"  are  lypothesised,  it  is  inporUnt  tnat 
?he  reSarch  design  San  ffom  the  start  to  be  a  longitudinal  one, 
5h5ri"  liSil*  s?hoS  Und  classroom  treatment  variables  are  measured  on 
successive  occasions  along  with  student  outcome  variables. 

Finally,  we  need  to  mention  one  other  i«P«>rtant  consideration  that 
should  guide  the  design  of  a  research  pJan  for  -tu^^ylng  the  effects  of 
ShSol  ind  classroom  practicss  on  student  outcomes,    '^though  the  most 
important  questions  on  this  topic  are  ^auul  in 
organisational  and  instructional  practices  •f'jct  the  fchijvements, 
attitudes,  and  behaviors  of  different  groups  of  ■tuf«nts— we  still  lack 
basic  ^^c^rini-lve  data  about  the  factors  discussed  in  the  model. 
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An  iniportant  contribution  of  N.C.E.S.  would  be  to  provide  this 
descriptive  information  as  part  of  an  effort  to  understand  how  these 
factors  affect  schooling  outcomes.    We  need  descriptive  information 
about  how  instruction  is  organized  and  conducted  for  different  subjects 
and  at  different  grade  levels  in  different  kinds  of  schools  serving 
diffeicnt  student  populations.    The  need  for  descriptive  data  requires 
that  increased  attention  be  given  to  sample  representativeness  and 
sampling  strategy*  <2> 

A  Suggested  Research  Design^ 

The  theoretical  model  guiding  this  discussion  is  a  broad  one, 
implying  a  vide  variety  of  research  needs  and  plausible  research 
strategies,  and  covering  the  full  range  of  organized  schooling  from 
kindergarten  through  oollegt*    Even  the  design  for  an  "umbrella*  study r 
under  which  specific  research  questions  on  specific  school  and  student 
populations  could  be  studied  in  more  detail,  must  leave  out  some  of  the 
possible  topics  and  coverage  of  schools  and  students.    What  ve  suggest 
below,  then,  constitutes  a  selection  from  among  the  universe  of  designs 
that  might  inform  the  questions  posed  in  oar  model. 

Because  we  are  interested  in  school  and  classroom  '^treatments,  *  ve 
propose  sampling  schools  and  classrooms  rather  than  students.  However, 
because  our  interest  is  in  outcomes  for  groups  of  students  of  particular 
ages  or  grade  levels,  stratified  samples  need  to  be  drawn  that  take  into 
/-      account  student  grade  levels,  and  student  data  should  be  collected  for 
students  in  a  particular  grade  in  sampled  classrooms. 

Five  major  goals  affect  the  choice  of  schools,  classrooms,  and 
students  to  be  sampled.    The  first  is  to  maximize  the  variety  of  types 
of  schools  (grade- level  ranges,  student  size,  public  vs.  non*public 
control)  included  in  the  sample.    This  goal  suggests  that  stratifying 
schools  by  size,  grade*span,  and  control,  and  drawing  samples  of  similar 
size  for  each  stratum  would  be  preferable  to  solely  sampling  schools 
with  probabilities  in  proportion  to  their  size. 

nie  second  goal  is  to  obtain  descriptive  data  on  the  methods  of 
classroom  instruction  used  at  as  many  grade  levels  as  practical.  This 
goal  suggests  that  at  least  teacher  data  be  collected  from  teachers  of 
all  grade  levels. 

A  third  goal  is  to  reasure  the  impact  of  school*level  treatments  on 
students.    This  suggests  sampling  classrooms  with  students  in  their 
first  year  of  being  exposed  to  such  a  treatment^-^-e.g. ,  sampling  7th 
grade  students  in  7-9  junior  highs,  and  6th  grade  students  in  6-8  middle 


<2>  By  itself,  causal  studies  are  less  dependent  upon  having  a  represen- 
tative sample  because  associations  between  school  practices  and  outcomes 
and  causal  relationships  involving  these  variables  are  likely  to  be  much 
more  stable  over  different  sub-populations  (of  schools)  than  are 
descriptions  of  school  characteristics  and  practices  themselves. 
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schools.  This  naxinizes  how  long  each  student  sampled  will  be  "exposed" 
to  the  school's  tcftataent  during  the  study  period. 

A  fourth  goal  is  to  aeasurt  the  effects  of  classroom  instructional 
practices  on  students*    In  tht  nany  schools  in  which  itudenti  are  taught 
by  nore  than  one  ttac.Htr»  this  requires  that  teacher  data  be  collected 
from  each  of  the  ttachtri  whose  instructional  patterns  night  affect 
individual  students  whose  outcomes  are  being  measured. 

A  fifth  goal  is  to  obtain  measures  of  school  effect  on  student 
outcomes  measured  across  transitions  to  new  schools  and  schooling 
levels.    This  goal  suggests  sampling  students  so  that  as  many  as 
possible  will  have  movtd  to  a  new  school  or  non-school  enviromtent  for  a 
similar,  limited  ^juration  (t.g. »  one  year)  prior  to  a  follow-up  survey. 
If,  for  example,  we  saaplt  students  in  their  first  ytar  at  a  school  with 
three  grades,  we  oould  follow-up  these  students,  say,  in  base-year  plus 
4 — that  is,  in  the  second  year  after  entering  their  next  level  of 
school ing. 

Although  some  of  the  goals  suggest  somewhat  contradictory  principles 
for  choosing  measurcnent  points  of  classrooms  and  students,  the  fol- 
lowing design  maximizes  attainment  of  the  five  goals  as  much  as  pos- 
sible.   In  particular,  it  takes  into  account  the  number  and  size  of 
schools  of  various  grade-level  ranges  to  maximize  diversity  of  school 
selection;  it  maximizes  the  length  and  purity  of  a  school  ^treatment"; 
and  it  maximizes  the  number  of  students  for  whom  we  can  measure  the 
impact  of  school  and  classroom  treatments  on  a  school  transition 
experience. 

According  to  this  design,  schools  would  be  stratified  into  the 
following  groups  according  to  grade-span  and  student  enrollment  per 
grade-level.    (See  Table  2.)    In  addition,  the  sample  would  be  further 
stratified  by  public  vs.  non-public  control,  although  this  is  not 
reflected  in  Table  2  below.    Sample  sizes  for  these  strata  need  not  be 
identical— that  is,  other  factors  may  need  to  be  considered  as  well— but 
the  sizes  should  reflect  a  primary  interest  in  obtaining  as  diverse  a 
sample  as  possible  along  the  stratification  dimensions. 


School-level  data  should  be  collected  from  appropriate  administrative 
persons  at  each  sampled  school.    Teacher  data — both  self-reports  of 
classroom  practices  and  "informant"  data  about  school  conditions — should 
be  collected  from  simple  random  samples  of  the  full-time  teaching  staff. 
Hie  sample  sizes  per  school  ^ould  reflect  both  a  minimum  number  (e.g. 
10)  and  decreasing  fractions  for  larger  schools.    In  addition,  however, 
the  sample  of  teacher  data  should  be  supplemented  in  order  to  obtain 
reports  from  each  teacher  responsible  for  the  instruction  of  students  in 
the  classrooo(s)  samoled  for  longitudinal  follow-ups  (see  below). 

Classrooms  selected  for  studying  the  impact  of  school  organization 
and  classroom  practices  on  student  outcomes  should  be  selected  accordi. 
to  the  grade-level  of  the  plurality  of  their  students;  they  should  be 
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Table  2: 


Number  of  Schools  Serving  Grades  5-12, 
by  grade  span,  by  enrollment  per  grade* 


Grade  Span  Number  and  Percent  of  Schools  by  Enrollment  Per  Grade 


c 


<25  students 
per  grade 


25  -  70 
per  grade 


PKrKrl 

12: 

3592 

(64%) 

1779 

(32%) 

PKrKrl 

8: 

7311 

(47%) 

7243 

(46%) 

PK,K,1 

6,7: 

3911 

(16%) 

13981 

(56%) 

PKrKrl 

5: 

738 

(  7%) 

5586 

(51%) 

4 

6: 

20 

(  2%) 

155 

(16%) 

5 

8: 

48 

(  4%) 

260 

(22%) 

6 

8: 

26 

(  1%) 

286 

(  7%) 

7 

8: 

13 

(  1%) 

126 

(  5%) 

7 

9: 

12 

(  1%) 

74 

(  3%) 

7 

12: 

580 

(17%) 

1503 

(45%) 

8 

12: 

70 

(13%) 

130 

(24%) 

9 

12: 

644 

(  6%) 

1758 

(17%) 

10 

12: 

45 

(  2%) 

151 

(  7%) 

Other  spans 
incl.  5-12: 

Spans  incl. 
PK  -  4  only: 


1086  (21%) 


1002  (12%) 


987  (19%) 


71 

per 

-150 
grade 

151  + 
per  grade 

Total 

Schools 

197 

(  4%) 

12 

(  0%) 

5580 

994 

(  6%) 

32 

(  0%) 

15580 

6612 

(27%) 

(  1%) 

24758 

43  9s 

(40% ) 

227 

(  2%) 

10946 

510 

(53%) 

273 

(28%) 

958 

588 

(50%) 

281 

(24%) 

1177 

1072 

(26%) 

2774 

(67%) 

4152 

389 

(14%) 

223  8 

(81%) 

2766 

281 

(11%) 

2148 

(85%) 

2515 

986 

(30%) 

275 

(  8%) 

3344 

187 

(35%) 

154 

(28%? 

541 

2598 

(25%) 

553  5 

(52%) 

10535 

299 

(14%) 

1723 

(78%) 

2218 

1317 

(26%) 

1747 

(34%) 

5137 

3276 

(40%) 

1017 

(13%) 

8088 

23701 

(24%) 

18690 

(19%) 

98301 

*  Source:  Data  tape  of  D.S.  School  Universe,  1984,  Quality  Education 
Data,  Denver,  Colorado. 

**  ^f^J"^^  schools  classified  as  voc-tech,  alternative,  or 

special  education  and  others  for  which  grade  spans  were  not  available. 
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restricted  to  classes  of  academic  subjects;  and  they  should  be  sair.pled 
in  proportion  to  the  nunber  of  hours  during  the  school  year  that  the 
students  meet  that  class.    At  each  school,  only  fPe^^ic  grade-levels 
should  be  saropled>  and  these  should  be  determined  by  the  grade-^pan  at 
the  school.    Our  preference  for  the  grade-levels  to  be  sampled  is  shown 
in  Table  3.    This  choice  takes  into  account  both  the  goal  of  sampling 
students  early  in  their  experience  at  the  school  and  the  goal  of 
providing  for  follow-up  studies  to  be  conducted  at  appropriate  points  it. 
the  students'  schooling  careers  (see  below)  . 

Table  3t 

Grade-Levels  Sampled  by  Grade  Span  of  the  School 


Grade-span        Grade-level  Grade-level  Grade-level 

of  school     of  classes  sampled  in  Year  3  i",,  * 

(Base  year)  -  follow-up  follow-up 

(Base  yr.  42)  (Base  yr.  44) 


P,K,1-12  4,7,10 

P,K,l-8  4,6 

P,R,l-6,7  4 

P,K,l-5  3 

4-  6  4 

5-  8  6 

6-  8  6 

7-  8  7 
7  -  »  7 

7-  12  7,10 

8-  12  8,10 

9-  12  10 
10  -  12  10 


6,9,12 

8,11,(14)* 

6,8 

8,(10) 

6 

(8) 

5 

(7) 

6 

(8) 

8 

(10) 

8 

(10) 

(9) 

(11) 

9 

(11) 

9,12 

11,(14) 

10,12 

12,(14) 

12 

(14) 

12 

(14) 

•  Parentheses  indicate  grade  levels  that  are  beyond  the  grade  leve: 
range  for  the  base  year  school. 
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Ke  aclcnovledge  that  sarolino       eer*^r^f«^    *  j  i> 
bTSr^n^fffSf"'^"  '^^  deslsn  should  te  deUrmlned 

student  groups  whose  outcomes  are  to  be  SUlSJid  oie?  lill.^ 

praJ?i?f''^tir,'J?on''Jr/2  ?"8ure  the  diversity  of  instructional 
liJori^Jli.!  !  'classroom-  should  be  defined  so  as  to 

incorporate  a  cluster  of  teachers  who  provide  -teamed-  teachinq--that 
aUJrnSJc^fS'^*?  ^"ching  practice-tra  common  gr Sup  of  Students 

ii?  <f  •"""-'  <r- 
self-contained  group  of  25  students.  teacning  a 

During  the  base  year,  each  classroom  should  be  studied  near  the 
beginning  of  the  school  year,  and  again  near  the  end  of  that  school 
year,  with  teacher  questionnaires,  student  questionnaires?  and  S^Isiblv 
a  Classroom  observation  instrument.    Then,  lach  ltSde""ho  2as^  mimber 

^JiJ^JllSSiSS        SSS"^'*''*""^^^.*  ^«  •"^  ••cond  school 

JJJfr  !C    !  ^  ^*  y**"^  •"^^  ^«  •nd  of  the  fourth  year 

SfiJt.^o»f5"!L^!!';  -^^strument  at  th.se"Sl^^up 

points  would  be  student  questionnaires,  but  teacher  practice  and  school 
organization  survey  Instruments  oouH  also  be  employSf  fSSs  J^rmi?- 

Dsing  the  initial  selection  of  grade-levels  according  to  school 
2  ?f^Z?F?" ^■''^^  ^  ^«  ^^'^  y«"  followup  (base  year 


iXLi  .Selected  DntstlsirnAiLs  itgms 


li        IJri?^i  H?"**^^  ^  measured  in  these  surveys  are  those 

itfu^fufi  iiS  m"/"  discussion  of  the  model  in  Figure  1.    For  school 
Sf  «t^«!n«  Lfi:""^®"  processes,  the  .utvey  should  include  indicators 
SvaluJtinSV^    n^.'"'  9""Pin?  practices,  scheduling,  monitoring  and 
evaluating  s  uuents,  opportunities  for  student  accomplishment,  as  well 

JliilJes^'JilSSKfoi^'iS:"'  ^"^her-teacher  relations,  aS3  educa??iial 
Climates,    ir,  addition,  the  surveys  shouJd  contain  measures  of  t»er 

2""?  P""""  """•"T*  •"-^"""ents,  .nd^ifuS^^oStcSL'^e^Isures 
behSJio??  personal  development,  attachment  to  school  and  good 
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1  .Ki-  f«r  th»  »utvev  to  obtain  attendance  and 
It  would  also  be  valuable  J®'  ^f*  '"^J^  ,°  re  results  for  each 
discipline  records  snd  :"Jfie/j5JjiJ^;%JSbJJm"Sf  establishing 
.tudeSt  sanipled.    8«""%2j^J5\eJlS;;^it  tests  used  at  different 
comparability  between  <>i^f«'f"'  *^f^"^!uiS       best  to  use  a  short  (20-30 
llTs  in  various  school.  SfSrSkE^'i^JS.  .toiSitieJed  to  fudents  as 

rdL§?nr..?inrsUri^nriecI:Urs%S^  test  .vailabl.  in 

school  files. 


„i.a  by  t»(^a.y  'J»"!,J%ot  tht."c""uj  U  tht  c.ctnt  book  by 

ePUuftiti?:.?*;  .choou  for  ,o»n,  .doU.e.nt.. 

Tb.  foiiowin, «.  fr.!.rcu.:^»'in."."to„*"on\tr^^^^ 

impact  cf  school  organisation  and  "J""!"-;-^^  only  a  limited  portion 
ITcomeB.    The  question,  included  J^^JJPJ^JJ J^Juy  at  .easuring 
of  the  survey  items  needed.    !j2,Jo«  grouping  practices,  scheduling  of 
rtrd:jrs^iKh:?t^inS^:«i^^^^  -  dustenng  Of 

instructional  groups. 

.Ou«tlo„«lr.  it».  vouia  dlff.r  to  d.,r..  .ccorain,  to  tb.  r.n,. 
of  9c«de  l«»tl»  at  th.  .ebool.) 

\"Z'Zu.t,  .t  your  «bool  .t.y  -It^  th.  ^J^f.^lJ'-^f ^.^U 

Studtntt  St»y  With  ».  8m.  a.sr  Ctoup  rot... 


Grade  6 
Grade 

Gr&d£  9 


All  Academic 
Subjects 

ALL 

ALL 

ALL 


Seme  Subjects 

But  Not  Others 

SOME 
SOME 
SOME 


None  (Each  Subj.r 
Different  Groups) 

NONE 

NONE 

NONE 
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For  Which  Subjects  Are  Qasses  Organized  by  Ability? 
CIRaE  ALL  THAT  APPLY. 

SOCIAL 


Grade  6: 
Grade  7: 
Grade  8: 


ENGLISH 
ENGLISH 
ENGLISH 


MATH 
MATO 
MATH 


SOCIAL 
SOCIAL 


SCIENCE 
STUDIES 

SCIENCE 
STUDIES 

SCIENCE 
STUDIES 


NONE 
NOME 
NONE 


c 


How  Many  of 
the  classes 
attended  by 
•  •  • 

...also  have 
at  least 
teverel. . . 

6th  graders 

7th  graders 

MOST 

MANY 

FEW 

NONE 

6th  graders 

8th  graders 

MOST 

MANY 

FEW 

NONE 

7th  graders 

8th  graders 

MOST 

MANY 

FEW 

NONE 

ERIC 
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4.    At  your  ichool,  what  kinds  of  teaching  assignments  do  most  teachers 
of  the  major  academic  fubjecta  have?    CIRCLE  ONE  CODE  FOR 
EACH  GRADE  LEVEL. 


Grade 
6 

Grade 
7 

Grade 

e 


Self-contained: 
each  teacher 
teaches  all 
subjects  to  the 
same  students 

SELF-CONTAINED 
SELF-CONTAINED 
SELF-CONTAINED 


Departmentalized: 
each  teacher  teaches 
the  same  subject  to 
several  different 
classes  of  students 

DEPARTMENTALIZED 


DEPARTMENTALIZED 


DEPARTMENTALIZED 


Mixed:  teachers 
teach  some  but 
not  all  subjects 
to  the  sair.e 
students 

MIXED 


MIXED 


MIXED 


5.    Some  schools  use  teaiE  scheduling  in  which,  for  example,  four 
teachers  of  different  subjects  teach  the  same  four  classes 
of  students.    Does  your  school  use  this  scheduling  nethod 
for  students?    (ANSWER  FOR  EACH  GRADE  LEVEL.) 


Team  Scheduling  Used? 


Grade  6 
Grade  7 
Grade  6 


YES 
TES 
YES 


NO 
NO 
NO 


IF  *YES*  FOR  ANY  GRADE  LEVEL: 

5a.    Is  there  •  specific  planning  period  set  aside  for 
each  group  of  teachers  who  work  together? 


YES 


MO 


332 


ERIC 


322 


c 


1.  Which  Of  the  following  best  describes  your  current  teaching 
assignment?     (CIRCLE  THE  NUMBER  TO  ME  RIGHT  OF  YOUR  CHOICE.) 

I  teach  one  group  of  students  for  the  entire  day   i 

I  teach  one  subject  to  several  different  classes  of  students"  2 
I  teach  several  subjects  to  more  than  one  class  of  stuSenJsf:.*  3 

2.  In  the  Uble  below,  list  the  subjects,  student  qrade-leveis  *nr^ 
Seir^'LSJ'iSv'rcfd'  clisses'that  ySS  V.lt  r^T 
^nd  Sociif  s?udLr  fJS^fh*'}*""  r"f^"  EngUsh,  Hath,  slience 
ON  A  SEpSa?^  T  iJ?'     ^            specialties.     LIST  EACH  SUBJECT 

ON  A  SEPARATE  LINE,  even  if  you  teach  them  to  the  same  cI.rr 
AND  LIST  EACH  aASS  ON  A  SEPARATE  LINE,  J?en  if  vorjeach  fhl 
same  subject  to  different,  classes  of  studies  in^Jhe  L'm'^  g?ade. 


SUBJECT  OF  CLASS 

EACH  SUBJECT  &  CLASS 
ON  A  SEPARATE  LINE 


t  HOURS  I 
I  PER  I 
I  WEEK  I 
!  I 


STUDENT 
GRADE 
LEVELS 
(K-12) 


a) 

1 
1 

1 
1 

1  Hi 

Av 

.  Lo 

Mx 

b) 

1 
1 

1 
1 

1  Hi 

Av 

Lo 

Mx 

c) 

1 
1 

1 
1 

1  Bi 

Av 

Lo 

Mx 

ABILITY  LEVELS 
High»Hi,  Average«Av, 
Low»Lo,  Nixed«Nx 


etc. 


3. 


The  remaining  questions  in  this  survey  concern  only  one  of 
b^"Jh«  SI!*;;  iVfhown  on  the  cover  of  the  booklet. 

S^tr^  ^^^'''f^i,*"?  time-of-day  that  you  meet  it.  which 

ll\X  i?  S*/^*'''! .  ^»  ^1*"  •"^^  subject  that  you 

teach  at  that  particular  time?    (WRITE  ITS  LETTER  —  "a",  "b",  etc.) 

LETTER  (Q.2)  OF  TOE  aASS  SAMPLED  FOR  STODY: 
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4.    Circle  all  of  th»  other  subjects  that  you  teach  to  the  same  group 
of  students  who  are  in  the  sampled  class. 


English   1 

Reading   2 

Kathenatics   3 

Scienct   4 

Social  Studits   5 

None  Other t  only  one  subject  to 

this  class   6 

Other  (specify) :   7 


5.    Sometimes  ttachtrs  divide  their  class  of  students  into  groups  for 
instruction  based  on  their  demonstrated  abilities.    Do  you  do  that 
for  any  subjtcts  which  you  teach  to  the  sampled  class?  (CIRCLE 
"YES"  OR  "MO".)    Zf  *yts»*  circla  tht  subjects  for  which  you 
ability-group  for  this  class. 

no/       do  not  ABILZTY-GROOP  for  TBIS  aASS 

YESt      ABZLZTY-GRODP  ZN  1BE  FOLLOWING  SUBJECTS 

FOR  IHZS  aASS:  (CZRCLE  AS  MANY  AS  APPLY) 


English   1 

Rtading   2 

Hathtmatict   3 

Scitnct   4 

Social  «tudi«s...  5 

Otbtrt   6 


€.    Do  you  ust  a  program  of  individual is ad  instruction  for  any  subject 
that  you  teach  to  tht  aampltd  class?    (CZRCLE  "YES" 
OR  "NO".)    Zf  *yta»*  circlt  tht  subjtcts  for  which  you 
use  an  individual  is td  program  of  instruction  for  this  class. 

NOt        DO  NOT  OIDZVIDDALZZE  INSTROCTZON  FOR  UZS  CLASS 

TESt      DSE  ZNDZVZDOALZZLD  PROGRAM  ZN  ISESE  SDBJECTS 
FOR  IBIS  aASSt  (CZRCLE  AS  MANY  AS  APPLY) 


English   1 

Rtading   2 

Hathtmatics   3 

Scitnct   4 

Social  Studies...  5 

Othtr :   6 
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7.    D3  vou  r.eet  with  a  team  of  other  teachers  who  teach  other 
^icade-.ic  subjects  to  the  same  group  of  students  who  are  in 
the  sar.pled  class?      (CIRCLE  ONE  NUMBER) 

No,  we  do  not  have  such  a  team  (CIRCLE  AND  SKIP  TO  . . . )   1 

Yes,  we  meet  at  regularly  scheduled  times   2 

Yes,  we  meet  informally  ,   3 

There  is  a  team,  but  we  rarely  meet   4 


8.    Counting  yourself,  how  many  teachers  are  on  your  teaching  team? 
NUMBER  OF  TEACHERS  ON  TEACHING  TEAM  FOR  IHIS  a  ASS:   


9.    When  you  meet  with  your  teaching  team,  how  often  do  you  do  each 
of  the  following  things?     (CIRCLE  ONE  OlOICE  FOR  EACH  ACTIVirY.) 


a)  spend  the  time  grading  OFTEN 
papers  from  your  own 

subject 

b)  prepare  your  own  lessons  OFTEN 
for  your  subject 

c)  discuss  the  performance  OFTEN 
of  Individual  students 

d)  arrange  to  visit  and  OFTEN 
observe  another  teacher 

with  the  sa^Tie  students 


SOMETIMES      SELDOM  NEVER 


SOMETIMES      SELDOM  NEVER 


SOMETIMES      SELDOM  NEVER 


SOMETIMES      SELDOM  NEVER 


e)  plan  curriculum  so  your  OFTEN 
subject* teaching  is 
coordinated  with  the 

other  trachers* 

f)  arrange  with  another  OFTEN 
teacher  to  jointly 

teach  the  sane  class 


SOMETIMES      SELDOM  NEVER 


SOMETIMES      SELDOM  NEVER 
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:e  HARVARD  UNIVERSITY 
.    Graduate  School  of  Education 

^     Monroe  C  Cutman  Library,  Appur^  Wav 
Cambndge.  Massachuietti  02138 

A  HOUSE  OF  BRICKS 

I  told  thaoi  «  thousand  times  if  J  to1<i  'wneo  onc8: 
Stop  fooling  around,  I  said,  with  straw  and  sticks; 
Th«y  won't  hold  up;  you'r«  taking  an  awful  chance. 
Brick  Is  the  stuff  to  build  with,  solid  bricks. 
You  want  to  be  liapractlcal,  go  ahead. 
But  Just  remember,  I  told  them;  wait  and  see. 
You're  making  a  big  mistake.    Awrlght,  I  $«id, 
But  when  the  wolf  cones,  don't  cone  running  to  me. 

The  funny  thing  Is,  they  didn't.  There  they  sat. 
One  in  his  crummy  yellow  shfick,  and  one 
Under  his  roof  of  tvigs,  and  the  wolf  ate 
Them,  hair  and  hide.    Mell,  what  is  done  is  done. 
But  I'd  been  willing  to  help  them,  all  along. 
If  only  they'd  once  admitted  they  were  wrong. 

(Hay,  The  Builders,  1961) 


Sixteen  comprehensive  reports  on  schooling  In  America  have  recently 
appeared,  detailing  the  present  woeful  state  of  affairs,  and  offering  a 
variety  of  solutions  for  falling  test  scores,  increased  functional 
illiteracy,  poor  teaching,  undisciplined  and  disinterested  children, 
inadequate  leadership,  and  an  incoherent  smorgasbord  of  curricular 
offerings.    Each  researcher  or  team  offers  to  build  a  new  "house  of  bricks," 
offering  more  rigid,  inflexible  structures  and  strictures,  "perks  and 
punishments,"  most  assuming  as  a  given  that  the  nineteenth  century  factory 
model  of  schooling  will  continue  to  survive  unchanged. 

Where  is  the  library/media  center  in  all  of  this  paper  blizzard  of 
fresh  Ideas?    When  the  indicators  are  that  some  S  million  adults  are 
functionally  illiterate,  and  that  13»  of  all  17  year  olds  in  the  United 
States  are  functionally  illiterate  (National  Commission  on  Educational 
Excellence,  A  ^^xiSS^  H  filjJi,  1983)  do  any  research  organizations  recognize 
the  traditional  role  of  libraries  in  stemming  an  avalanche  of  llliterati? 
Is  there  even  a  k,h1sper  hidden  in  the  clamor  of  voices  that  says,  "What 
about  school  libraries?" 
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Die  a  single  researcher  folio*  the  students  through  their  CiUy 
routines  Into  the  place  that  I  normally  regard  as  the  Inforiratlon  "soul"  of 
every  schoolt  where  learning  activities  and  materials  meet  inqulsltivf:  minos 
In  frenetic  or  leisurely  embrace?   The  silence  is  almost  total.   Other  than 
a  single  study  that  measured  library  space  and  amount  spent  on  collections, 
relating  thes*  factors  negatively  to  child  development  (Bloch,  EffgctWe 
Schools.  1983).  not  one  analysis  attended  to  libraries  or  media  centers  as 
part  of  educational  assessaent  or  as  an  instrument  for  educational 
improvement. 

Ho«  did  it  happen?    The  star  that  rose  so  swiftly  and  shone  so 
brightly,  is  wavering  precipitously,  in  danger  of  obliteration.    On  evtry 
level,  local,  state*  and  particularly  federal  -  at  the  sane  tine  as 
computers  and  computer  literacy  prograns  have  captured  the  public  in  a 
panacea  of  purchase  -  library  and  nedia  prograns  have  lost  the  support  of 
the  povrer  brokers  and  the  gnneral  public    At  ttf  sane  nonent  that  the 
possibilities  of  an  infornation  era  are  titillating  imaginations,  few  have 
Jiggled  their  sinds  sufficiently  to  realize  that  infornation  storage  and 
retrieval  has  always  been  intrinsic  to  libraries.    Instead  of  selecting 
nedia  specialists  as  superintendents  and  assistant  superintendents  for 
curriculun  (they  have  both  edninistrative  and  curriculun  skills)  their 
positions  are  being  downgraded,  while  athletic  directors  or  vocational 
education  adninistrators  continue  a  steady  ascent  to  the  top  positions  in 
educational  adninistration.   The  enornlty  of  changing  a  public  inage.  so 
firnly  ingrained  even  by  librarians  and  nedia  personnel  themselves,  in  a 
world  where  access  to  infornation  is  truly  the  new  power  base,  boggles  the 
Inaglnation. 

That  is  not  to  say  that  NCES  has  neglected  the  gathering  of  statistics 
about  the  connunity  of  libraries  -  school,  public,  and  acadenic.   Numbers  of 
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^/o^umes  are  reported  annually  by  organizations  and  reported  In  the  Digest  of 
EiiucflllQQ  Statistics*    This  information  is  of  limited  value  without 
knowledge  of  currency  or  research  value»  without  any  correspondence  to  the 
curriculum,  without  information  about  a  range  of  materials  -  visuol#  oral# 
tactile^  and  their  relatedness.   A  small  independent  school  ir  New  Hampshire 
proudly  boasts  of  10»000  volumes.    Close  examination  revealed  (Miller^ 
unpdbl       d  report*  1984)  that,  the  volumes  were  primarily  donations  from 
well-wlshers*  and  a  spot-check  of  th^  shelves  showed  no  use  by  students  of 
the  yitire  collection.    In  the  decade  that  lies  ahead  access  to  information 
resources  will  be  of  far  greater  concern  than  quantities  of  bound  volumes. 
When  third  grade  children,  particularly  in  middle-class  comrunitif  .  can  do 
encyclopedia  research  via  modem  there  must  be  e  corollary  use  considered  in 
statistics  gathering.   How  many  databases  are  being  accessed  by 
elementary/secondary/col  lege/ vocational  students?   How  are  the  resources 
organized  for  maxiBun  efficiency?    What  are  the  delivery  systems?   What  are 
the  programs  in  institutions  to  train  teachers  and  students  about  the  use 
end  limits  of  the  avalanche  of  information*  soon  to  be  availab^j  with  a  few 
strokes  of  the  fingertips?    How  often  can  children  access  these  information 
resources?    Is  it  once  <i  weo(^  for  fifteen  ainutM  in  e  weekly  library  trip. 
Recent  information  ebout  computers  (Becker*  School  Use  qI 
Microcomputftrs.  1984)  indicates  that  the  average  sxudent  can  use  e 
microcomputer  for  15  minutes  per  week.    The  use  of  the  11t/k\?r^/  in  many 
schools*  elementary  end  secondary*  is  also  severely  restricted^  not  for 
ulpment  or  space  but  by  structural  limitations  of  school  org^nizatlor. 
Even  counting  numbers  of  things  like  books  or  filmstrips  pcses  definitional 
problems  (volum#«  or  titles?  purchassd  or  acquired  through  grants  and 
donations?  useful  or  worthless?)  The  difficulties  in  keeping  track  of 
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inforraatlcn  about  stuflents  Is  compounded  when  discussing  the  resources  for 
learning.    Definitional  problems  and  lack  of  specificity  plague  ESEA  Title 
III  Offices  In  State  Departments  of  Education,  i*rpons1ble  for  rscord 
gathering.    Limited  staffs,  unable  to  undertake  spo';-check.1ng,  and  schools 
•ith  conflicting  Interests  In  determining  future  formula  allocations  have 
much  to  lose  In  maKing  accurate  reports.    Secondary  reporting  sources 
compound  the  effects  of  Inaccuracies  and  self-interest. 

Methodology  for  both  counting  and  reporting  of  Information  does  not  use 
current  technologies.    SoaetiM  during  the  next  decade  It  will  become 
apparent  that  It  Is  feasible  to  have  ti.e  local  organization  report  by  modem 
Into  •  clearly  defined,  standa-dlzed  set  of  categories,  updated  regularly  at 
the  primary  source.   Unless  such  data  become  ramoved  from  Identifiable 
funding  decisions,  reliability  will  continue  to  be  suspect.    Even  the 
Harvard  Annual  Report  by  the  University  Librarian  has  much  difficulty  with 
the  statistical  aspects.   Other  than  the  accumul-tion  of  computerized  data, 
a  creative  tour  de  force  would  best  describe  the  individual  faculty  11br»^ry 
reports.   Each  librarian  is  well  aware  of  the  effect  of  straying  beyond 
prescribed  limits.   With  regard  to  school  tnstrvctlonal  materials,  their 
dating,  relevancy,  and  use  are  more  important  Jata  for  researchers  than 
present  statistics. 

NCES  also  publishes  information  about  numbers  of  professional 
library/media  personnel.    Once  again  definitions  and  specificity  are  the 
issues.   What  is  a  library  facllityT   Today.  In  the  same  way  as  grade  and 
age  groupings  are  difficult  with  disparate  school  organlzatloniil  groupings, 
so  too  are  libraries,  media  centers.  Instructional  material  ficllUles, 
teacher  centers,  television  studios,  computer  operations  or  labs,  equipment 
storage  facilities,  materials'  warehouses  all  loosely  Joined  together 
without  any  coherent  or  comprehensive  definition.    People  who  operate  any  of 
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these  facilities  might  .^e  listed  as  media  professionals  for  statistical 
purposes.    When  operations  are  expanded  by  schools  to  encompass  the  whole 
range  of  Information  access  tr.d  retrieval,  then  a  ne*  nomenclature  «i111 
replace  the  Jumblo  that  presently  exists.    If  a  distributed  form  of 
education  begins  to  replace  traditional  class  structure,  and  tncllllary 
organizations  (I.e..  museums,  public  libraries,  homes)  become  primary 
learning  sites,  data  gathering  can  be  built  Into  remote  learning  systems, 
with  Information  available  about  student,  teacher,  and  type  of  program. 

For  the  past  tjveral  years  Gutatn  Library.  Harvard  Graduate  School  of 
Education,  funded  by  a  federal  program,  has  been  collecting  Information  from 
10.000  educational  Institutions  about  their  use  of  microcomputers.    The  data 
•re  being  counted  on  Compuserve.  «  large  national  information  utility.  As 
schools  begin  to  report  numbers  of  microcomputers,  conflicting  Information 
comes  from  Individual  schools  and  central  administrative  offlcms.    Much  of 
this  equipment  did  not  comm  from  traditional  budget  sources.  There  are  f9w 
accurate  records.  The  lack  of  reliability  Is  apparent  In  all  data  gathering 
•round  microcomputers  by  NCES.  Market  Data  Retrieval,  Gut».an  Library  of 
Harvar**  Graduate  School  of  Education,  whether  In  ttf  areas  of  hardware, 
software,  or  use  of  the  computer.   The  limited  knowled^*  acquired  by  central 
Information  sources  leaves  researchers  wallowing  In  fuzzy  figures  anl 
amorphous  analytics.    In  a  phenomennr ,  somewhat  akin  to  the  purchase  of 
television  receivers,  that  began  es  a  bottom  up  movement,  and  was  profoundly 
Influenced  by  parents  and  the  outside  media,  more  substantive  statistics 
would  be  available  from  equipment  manufacturers  and  software  producers. 
Flagrant  violation  of  copyright  by  Individual  schools  with  regard  to  copying 
software  will  preclude  any  possible  estimation  of  the  numbers  or  types  of 
instructional  computer  programs  used  In  the  nation'*  schools  or  homes.  Even 


thesi  constraints  art  negligible  *hen  compared  to  the  lack  of  Informatlcn  by 
teachers  about  the  kinas  of  completer  use  that  engage  thilr  stuCents.  The 
s.^merged  nature  of  the  culture  and  the  lack  of  Instructlontl  experience 
result  In  compilation  of  formalized  programs  by  designated  computer 
instructors.   Reseirch  fro«  the  Harverd  deta  biise  followed  by  visits  to 
selected  school  systems  reveal  a  standardized  progression  of  computer  use 
(Miner,  A  National  Pftrspectlve-Micrt^eomDuters  Mi  Sfiiicali.  unpublished 
speech*  1965). 

Increislngly  during  the  cosing  decade  schools  will  befiin  to  incorporate 
large-scale  computerized  curriculum  systems  on  networked  systems,  supported 
by  individual  Itp  computers  end  enrichment  or  remedial  .aterials  to  be  tsed 
in  the  classroofli  or  the  hone.    These  large  systems  will  Incorporate 
individualized  inforaation  about  each  student  as  well  as  composite  data. 
Now  is  the  tiae  for  NCES  to  begin  working  cooperatively  with  schools  in 
preparing  .eaningful  daU  tbout  student  progress  with  new  learning  tools. 
Where  are  students  using  computers?    Is  there  one  computer  in  the  classroom, 
a  computer  lab,  take  hoae  coaputers,  preparation  of  parents  as  well  as 
teachers?   Are  teachers  trained  and  involved  in  the  planning  process?  Are 
the  computers  part  of  the  regular  curriculum  or  relegated  to  outside 
computer  courses?    How  art  they  being  used?    Wh«t  is  the  relationship  to  the 
reading  or  mathematics  program?    Are  there  supplemental  .aterials?   There  is 
a  need  for  contextual  information.    What  applications  programs  will  be  part 
of  the  nc«  curriculum?    Data  about  ttie  efficacy  of  technology  nas  been  of 
little  apparent  utility  when  the  concentration  is  the  equipment  rather  than 
the  software  or  the  usage. 

As  schools  and  universities  concern  themselv     <ith  access  to 
computerization  and  wiring  their  buildings,  much  is  taking  place  beyond  the 
formal  walls  that  will  have  a  profound  Influence  upon  the  future  of 
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•Oucatlon.    The  aavent  of  telecommunications  as  part  of  a  formal  eoucatlonal 
process  is  already  in  place  in  such  i^istitutions  as  Nova  University,  New 
York  Institute  of  Technology,  and  Ne*  Jersey  Institute  of  Technology.  A 
kind  of  extended  correspondence  program  or  new  form  of  bussing  of 
information  rather  than  students  takes  place  nightly,  with  students  involved 
in  serious  doctoral  study.    They  sit  in  Arizona  or  Fort  Lauderdale,  studying 
and  learning  together.    They  are  diverse  ages,  learning  from  home  or  place 
of  business.   They  are  part  of  a  new  world  whe-e  Jobs  are  not  forever,  and 
the  need  for  ne.  skills  extends  far  beyond  the  traditional  college  cohort. 
Soon  they  will  be  Joined  by  networks  of  gifted  children  in  visionary 
■projects  out  of  Johns  Hopkins  or  Pouch  F,  Alaska. 

There  are  profound  implications  here  /or  those  who  are  planning  the 
statistics  gathering  for  the  nation.  These  students  involvmd  in  remote 
learning  programs  will  extend  the  complexity  of  daU  gathering  both 
generically  and  geographically.   New  schools  will  arise  to  be  credential  led 
and  incorporated  Into  the  network  of  independent  or  public  institutions. 
Traditional  organizations,  with  declining  demographics,  will  seek  students 
tn  corporations,  among  alumni»  and  In  community  groups.   Home  learning, 
•Iready  increasing  nationally,  will  reech  out  to  the  preschool  tnd  the 
handicapped  and  the  aged.   New  programs  for  delinquent  youth  and  adolescent 
pregnant  mothers  are  taking  place  outside  the  classroom  or  professional 
teaching  faculty.    Already  the  Reference  staff  at  Gutman  Library  is 
reporting  increased  call,  from  doctoral  students,  for  statistics  on  non- 
traditional  learners  and  new  technologies  In  the  learning  process.  They 
want  data  on  these  populations,  their  ages,  spending  patterns,  and 
educational  backgrounds.    They  want  to  know  more  about  changing  careers  and 
the  need  for  Increased  schooling.    They  want  better  indexing  ana  referencing 
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of  all  information  presently  available.    They  want  better  use  .f  -irrent 
technologies  In  standard  reporting. 

As  NCES  begins  Its  approach  to  the  2lst  century,  the  use  of  CT  Rom 
filsks  for  reporting  of  text  Information  will  play  a  part  In  the  ability  of 
research  organizations  and  schools  to  more  easily  access  and  manipulate  the 
mass  of  statistical  data  being  collected.    The  organization  and 
standardization  of  databases  has  begun  to  be  of  interest  to  «ult1-nat1onal 
corporations  as  they  look  to  decision  Baking  based  up^n  statistical  analysis 
and  examination  of  historical  precedent.   The  same  opportunities  are 
available  to  organizations  within  the  educational  world  if  there  is  a  real 
impetus  for  change,  or  if  the  whole  search  for  educational  excellence  is  not 
9  charede  or  "a  dance  of  legitimacy"  (Deal,  1984). 

The  Public  Library  he$  •  proud  history  in  this  country.    It  lerved  to 
educate  thousands  of  iaalgranU,  and  brought  the  culture  of  •  new  land  anU 
its  language  to  peoples  desperate  for  ecculturation.    Today  the  country 
still  has  great  need  for  data»  for  Information,  and  for  knowledge.  There 
are  new  sources.  There  are  new  possibilities.   There  are  new  Mthods  for 
information  transfer  and  retrieval,  ".-he  library  In  school,  university, 
corporation,  and  the  com.unity  -ill  continue  to  play  *n  essential  role.  It 
will  be  the  foundation  for  a  new  "house  of  bricks." 
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INTRCDUCTICN 

The   purpose  of  this  paper   is  to  suggest   priorities  for 
the  federal   government's  elementary  and   secondary  education  data 
collection  efforts.      My  suggestions  reflect   not   only  my  own 
ideas,    but  also  things  I  have   learned  while  participating  in 
discussions  of  the  Ne^tional   Research  Council   Committee  on 
Indicators  of  Precollege  Science  and  Mathematics  Education.  This 
committee  has  spent  a  great  deal   of  time  over  the  last  six  months 
discussing  the  quality  of  available  data  on  LI,S#   elementary  and 
secondary  science  and  mathematics  education,      I  have  tried  to 
indicate  where  my  ideas  differ  from  those  voiced  by  other  members 
of  the  Committee. 

I  have  organized  the  paper  in  th/es  sections:  outputs, 
inputs,    and  private  schools.      In  each  case,    I  consider  what  we 
would  like  to  know,   what  the  available  data  are,  and 
recommendations  for  the  federal   government's  data  collection 
efforts* 


I.  OUTPUTS 


0.   Test  scores 

1.    Nat  ional  fissessrnent   of  Educat  ional  Progress 


What    is  happening  to  the  cognitive  skill   levels  of 
children  attending  American  schools''     We  know  much  more  about 
this  ques*,.ion  than  we  did  twenty  years  ago,    primarily  because  of 
i  the  National   Assessment   of  Educational   Progress    (NPEP).      The  NPE^^ 

data  have  told  us,    for  example,  that: 
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— the  reading   skills  of  9-year~old  children   improved  over  the 
1970s,    and  tne  gap  between  the  reading  skills  of  black  children 
and  white  children  closed  somewhat; 

— the  avarage  science  skills  of  students  in  all   age  groups  fell 
between  1970  and   1S73;   the  skill   levels  of  9-  and  13-year-old 
students  were  stable  over  the  period   1973-77,    while  the  average 
science  skills  of  17-year-olds  fell   still  further. 

While  the  NfiEP  tests  results  have  been  informative,  there 
are  important  questions  concerning  exactly  what  the  tests 
measure.      In  particular,   many  analysts  have  argued  that  the  NfiEP 
tests  do  not  measure  higher  order  learning  skills.  Other 
analysts  have  argued  that  the  tests  do  not  even  provide  good 
measures  of  children's  basic  science  literacy.     The  limitations 
of  the  NfiEP  tests  and  other  tests  of  students'   cognitive  skills 

[ 

are  worrisome  for  four  related  reasons. 

First,   we  simply  do  not   know  whether  the  evidence  on 
national  trends  in  skill   levels  would  bfe  different   if  the  tests 
provided  better  measures  of  cognitive  skills,   especially  the 
critically  important  higher  order  skills. 

Second,   the  lack  of  evidence  on  students'   highi  '  order 
skills  makes  it   impossible  to  differentiate  among  alternative 
explanations  for  puzzles  posed  by  the  NOEP  test  results.  For 
example,    the  NftEP  results  indicate  that  the  reading  skills  of  9— 
yBar"-o]d3  improved  over  the  1970s,   while  the  reading  skills  of 
'17-year— olds  remained  stagnant  or  fell.     One  possible  explanation 
for  this  pattern  is  that  the  NAEP  tests  do  not  measure  the  true 
skill   levels  of  older  children  as  well  as  they  mea«fure  those  of 
younger  children,    and  that  our  schools  have  in  fact  been  as 
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successful    xn  educating  oid£:»r  students  as     they  have  been  in 
educating  younger  students.      Another  possibility   is  that  the 
amonasis  on  basic  skill  acquisition  in  thm  »arly  gradss  has  had 
deleterious  effects  on  students'    acquisition  of  higher  order 
reading  skills.      If  true,    this  may  have   implications  for  how  we 
teach  children  in  the  early  grades.      Yet   another  possibility  is 
that  many  of  the  younger  children  benefited  from  participating  in 
a  well-developed  Title  I  compensatory  education  program,  while 
older  children,    if  they  participated   in  Title  I   at  all,    did  so  in 
Title  I's  uncertain,    early  years.      We  cannot  differentiate  among 
these  possible  explanations  for  the  test  score  patterns  until  we 
have  better  meas  >"es  of  students*   higher  order  reading  skills. 

Third,    when  test  scores  are  used  to  assess  the  quality  of 
educational   programs,    they  tend  to   influence  curriculum.  The 
content  of  the  NflEP  testa  may  assume  this  role  in  the  years  to 
come  as  states  contract  with  NftEP  to  provide  detailed  scores  that 
can  be  used   in  statewide  assessments  of  the  quality  of  schooling. 
It  would   be  extremely  unfortunate   if  the  lack  of  emphasis  on 
higher  order  cognitive  skills  in  assessment  tests  led  to  a 
reduction  of  emphasis  on  these  skills  in  the  curriculum. 

ft  fourth  reason  for  concern  about  test  qual ity   is  that 
student  test  scores  are  the  measure  of  teaching  effectiveness 
used   in  almost  all  studies  of  the  characteristics  of  effective 
teachers  and  the  determinants  of  effective  teaching.      If  the 
tests  do  not  measure  well  the  skills  that     chidren  need  to  learn 
and  that  good  teachers  strive  to  teach,    studies  of  the 
determinants  of  teaching  effectiveness  may  give  very  misleading 
results. 
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Recornrnendat  i  ons ; 

1.  Continued   funding  for  NfiEP  should  have  a  very  high  priority. 
Current   plans  to  increaso  the  frequency  with  which  math  and 
science  skills  are  tested  should  be  retained, 

2.  The  federal  government  should  support  Educational  Testing 
ServiC9'«  efforts  to  d»v»lop  better  NflEP  tests.      It  i« 
worthwhile  not  only  to  develop  better  multiple  choice  tests, 
but  also  to  develop  and  utilize  subtesti:>  that  provide  for 
open-ended  responses  to  questions.     This  type  of  test   item  has 
greater  potential  for  measuring  students'   higher  order 
cognitive  skills, 

3.  While  it   is  critical  to  introduce  better  tests  as  soon  as 
possible,      it   is  important  to  retain  enough  of  the  old  test 
items  to  permit  comparison  of  new  NflEP  test  results  with  the 
results  of  previous  t«sts. 

2.      Scholastic  fiotitude  Tests   (SfiT)   and  American  College 
Ti^^^s  (PCT) 

In  recent  years,   comparisons  among  states  of  average  SflT 
scores  and  average  fiCT  scores  have  become  increasingly  popular. 
For  example,   they  have  a  prominent  place   in  the  "Secretary's  Wall 
Chart,"     It   is  well  known  that  the  average  score  in  a  state  is 
sensitive  to  the  average  family   income,    the  percentage  of  high 
school  seniors  in  the  state  who  take  the  test,    and  the  percentage 
of  students  who  attend  private  schools   (Dynarsky,    1983;  Howe, 
1385)  •      Moreover,    in  New  Hampshire,    the  average  SAT  score  is 
high,    in  part,    because,    included   in  the  calculation  are  the  high 
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scores  of  students  from  other  states  who  attend  private  high 
schools   in  New  Hamoshire.      This   is   probably  the  case   in  other 
states  as  well.      fls  a  result   of  the  influences  on  these  nonschool 
variables  on  average  SfiT  and   fiCT  scores,    these  average  scores  are 
relatively  poor  indicators  of  the  quality  of  public  education 
provided  to  students  in  particular  states. 
Rgcommgndat  ion  a 

If  the  federal   government  must  publish  average  SfiT  and  ACT  scores 
by  state,    publish  alongside  them  an  adjusted  set  of  scores  that 
takes  into  account  the  influences  of  participation  rates,  family 
income,    and  private  school  attendance.     Such  adjusted  scores 
could  be  calculated  relatively  easily  using  multiple  regression 
methods.     My  guess  is  that  these  adjusted  scores  would  have  a 
somewhat  different   pattern  from  +he  simole  average  scores.  If 
this  is  the  case,   discussion  of  the  reasons  for  the  differences 
would  be  provocative,   and  maybe  even  informative. 


3.      International   flssoclation  for  Evaluation  of  Educ^>tion 
Achievement    (TEA)    Cross-national  Test  Comparisons 

Comparing,   at  one  point  in  time,   the  average  math  and 

science  scores  of  students  in  different  countries  poses  a  host  of 
problems.      In  particular,    differences   in  the  quality  of  national 
scnool  systems  Is  only  one  of  many  reasons  why  average  test 

scores  differ  among  countries.     Consequently,    I  am  skeptical 
about  the  possibilities  of  drawing  reliable  inferences  about  U.S. 
education  from   international   comparisons  at   a  sirqlg  ooint  in 
llIQe.     Comparisons  over  time  offer  much  better  prosaects, 


however.      In  particular,    it    is  possible  to  examine  how  the 
achievement   of  U.S.    students,    as  measured  on  the   lEfl  tests, 
changes  ovor  timiB,    and  whothar  the  Do^ition  of  U.S.  studor.^a 
relative  to  studer^s   in  other  countries  changes  over  tirn??. 
RgcomnrtgncJat  ions i 

1.    Continue  financial   suoport   for  the   lEA  testing  program, 
emphasizing  the  need  to  use  test  and  sample  designs  that 
permit  com par i sons  ov«r  t  imo. 

S.    NCES  should  play  a  larger  role   in  the  implementation  of  the 
lEA  tests  in  th«  United  States. 

3.  Greater  effort  should  be  made  to  administer  the  lEfl  tests  on  a 
regular  scnedule  so  that  comparisons  over  time  can  be  ma:je 
more  reliably. 

4.  The  Council  of  Chief  State  School  Officers  should  be  involved 
in  administering  the  tests.      This  would  improve  local 
cooperation  and  reduce  sampling   bias  due  to  nonresponse. 


B.    Dropout  Rates 
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One  important  mf?asure  of  the  extent  to  which  our  scnools 
accomplish  the  ambitious  goal  of  educating  all  students  is  the 
percentage  of  students  who  graduate  from  high  school.  Most 
commonly,   data  are  collected  on  dropout  rates,   which  conceptually 
provide  the  tiame  information  as  graduation  rates.     However,  as 
Cook,    Ginsberg,    and  Smith    (1385)   have  documented,   U.S.    data  on 
dropout  rates   (and   graduation  rates)   are  of  very  poor  quality. 
The  most  common  calculation  method,    comparing  the  number  of 
students  who  graduate  in  year  n  with  the  number  of  students  wno 


346 


356 


f?ntered   high   school    in  year  n--3,    is  flawed   for  a  nun^her  of 
reasons,    the  most   imQcrtant   of  which   is  tne  high  mobility  rate  of 
ftmerican   ramilies,      P  critical  effact  of  mobility  i3  that   it  is 
not   possible,    using  the  standard  calculation  method,  to 


distinguish  a  student   who  has   left   formal  schooling  entirely  from 
a  St ud»nt  who  ha«  cransf arrod  to  a  school   in  anotl^wr 
jurisdiction.      This  problem  is  more  severe  the  smaller  the 
jurisdiction  because  mobility  across  jurisdictions   is  more 
prevalent.     Consequent  ly,   dropout  rat e«:  for  individual  schools, 
if  calculated  by  the  method  described  above,    are  p>-obably  less 
accurate  than  dropout  rates  fcr  individual  stat'2s~al though  even 


stata  dropout  rates  are   influenced  by  familv  migration  patterns. 

It  would  be  extremely  valuable  to  have  data  series  that 
provide  comparable?  data  on  drooout  rates  for  ind'^vidual  schools, 
school  distriu^ts,   and  states.     Such  data  are  particularly 
important  to'  have  at  this  date  as  many  states  tighten 
requirements  for  high  school  graduation,   requiring,    for  example, 
that  students  complete  mo^^e  math  and  science  courses  and  pass  a 
minimum  competency  exam.     One  of  the  adverse  consequences  of  the 
i.i^w  regulations  may  be  that  dropout  rates  increase-      It   is  also 
likely  that  the  effect  of  the  new  graduation  requirements  on 
dropout  rates  will   be  sensitive  to  the  grade  level  at  which 
minimum  competency  tests  are  administered  and  the  extent  to  which 
systematic  ramedial  help  is  available  to  students  who  fail. 
Reliable  datit  permitting  comparisons  of  dropout  rates  among 
states,    and  within  states  over  time,    would  be  valuable  in 
determininq  how  tightpnod  requiromants  affect  dr^opouts  and 
whether  the  effects  are  sensitive  to  the  details  of  the  programs. 
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Reoommendat i ons ; 

1.    NCES  should  w^rk  with   the  Council   of  Chief  State  School 
Cficers    (CCSSO)    to  develop  and   implement   a  uniform 
methodology  for  calculating  dropout  rales.     Given  the 
sensitivity  of  many  state  departments  of  education  to  federal 
pressure,    achieving  agreement  will   not  be  easy.      I  speculate 
that   it   is  more  than  historical  chance  that  explains  the 
differences  in  methodologies  used  by  individual  states  to 
calculate  dropout  rates.      States  probably  have  good  reasons 
f « r  choosing  a  particular  methodology.     Understanding  why 
individual  states  calculate  dropout  rares  as  they  do  would  be 
helpful    in  negotiating  movement  toward  a  uniform  methodology. 
Consequently,    a  first   step   in  improving  data  on  dropouts  is  to 
systematically  listen  to  the  reasons  dropout  rates  are 
calculated  as  they  are  in  the  individual  states.     The  Council 
of  Chief  State  Scnool   Officers  may  be  an   imoortant  vehicle  for 
soliciting   information  on  methodologies  for  calculating 
droDout  rAt»»,   and  fo^  Achi«vi;^g  ag^^wment  on  a  uniform 
mothodol ogy , 

2.   NCES  should  encourage,    and   if  possible,    fund  studies  that 

•xamin©  wh^thar  dropout  rates  a3  calculated  by  applying  a  new 
uniform  methodology  to  school,   school  district,    and  state 
level  data  are  close  to  dropout  rates  calculated  from 
longitudinal  data  on  individual  students^    such  as  that 
provided   by  HS&B.      The  reason  is  that   following  individual 
students  over  time  is  unquestionably  the  best  way  to  learn 
about  the  dropout  rates  of  students  with  particular 
cnaracter j st ICS  who  participate   in  particular  kinds  of 
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ecucat lonal   programs.      In  a  world  of  no  budgetary  constraints, 
we  would  want  all   calculations  of  dropout  rates  to  be  done 
with   individual,    longitudinal  data.    If  a  new,  common 
methodology  for  calculating  dropout  rates  with  aggregated  data 
is  indeed  satisfactory,    then  the  estimated  rates  should  be 
similar  to  those  calculated  with  data  from  HS&S. 

C.    Life  Outcomes:   Earned   Income,    Occupat  ion,    Probabi 1 ity  of 
Employment 


While  American  education  has  many  goals,    no  one  would 
deny  that  a  central  one  ia  to  prepare  students  with  the  skills 
and  attitudes  that  will   help  them  to  earn  a  good   living.  How 
well  do  our  schools  accomplish  this  goal?     This  question  has  been 
hotly  contested  over  the  last  £5  years,   with  advocates  of  the 
"human  capital"  approach  documenting  the  accomplishments,  while 
others,    for  example,    Christopher  Jencks   (1972),    documenting  trie 
failures.     One  point  on  which  all  analysts  who  have  studied  the 
"economic  returns  to  education"    issue  agree  is  that   learning  more 
requires  better  data.     The  data  sets  used  by  Jencks  and  the  human 
capital  economists  provide  only  minimal   information  about  the 
kinds  of  education  students  received.     We  need  datasets  that 
provide  detailed   information  on  children's  scnooling  as  well  a^ 
information  on  post-schooling  careers  and   income  paths. 

Creation  of  the  National  Longitudinal   Study  of  the  High 
School  Class  of  1372   <NLS72)    was  a  majo*^  step   in  creating  a 
database  that   provided   good   information  on  students'  school 
experiences  and   longitudinal    information  on  their  subseauent 
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labor  nia.-'Pet  experiences.      Pn  irnportant   lirnitation  in  the  NLS7£ 
database,   however,    is  that  studsnts  were   interviewed  for  the 
first  time  during  the\r  senior  year  in  high  school,    after  most  of 
the  fo^^mal  schooling  was  completed. 

The  Hi  gh  School   and  Beyond  project   is  another  i moor t ant 
step  in  providing  good   longitudinal   information  on  the  schooling 
and  subsequent    labor  market  experiences  of  American  students. 
From  th«  HS4B  data,   we  have  already  learned  that  the  type  of 
schooling  students  receive  has  a  marked  impact:  cn  their  cognitive 
skills.      I  expect  that  subsequent  research  will  tell  us  a  great 
deal  about  the  impact  of  particular  types  of  schooling  on 
subsaqent   labor  market  experiences.     The  longitudinal  study 
slated  to  begin  in  1388   (NELS)   offers  even  moro  promise  for 
increasing  our  understanding  of  the  roles  formal  education  plays  > 
in  affecting  life  outcomes;  NELS  will  conduct  baseline  interviews 
when  children  are  still   in  elementary  school    <grade  S) . 
Recommendat  ions; 

1.  Continue  to  fund  additional   follow-up  surveys  of  both  the 
NLS72  and  HSEtB  cohorts.      It  is  important  to  collect 
information  on  members  of  the  NLS72  and  HS&S  samples  as 
individuals  age-     Many  important  effects  of  different  types  of 
schooling  may  not  become  evident  until  individuals  reach  their 
mid-thirties. 

2.  Do  not  reduce  the  sample  sizes  in  the  NLS72  and  HS43  follow-up 
surveys.    Th  is  is  cr i  t  ical   because  many  important  quest  ions  can 
be  addressed  with  these  data  only  if  relatively  large 
subsamples  with  particular  characteristics  are  retained.  For 
examole,    Manski    (1383)   has  recently  conducted  an  imoortart 
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study  of  the  characteristics  of  members  of  the  NLS72  sample 
who  became  teachers.      This  could  be  done  only  because  the 
overall  sample  size  in  the  follow-up  surveys  was  sufficiently 
large  to  include  510  individuals  who  became  teachers.  (See 
Section  II   for  more  on  the  Manski  study.) 
3-    Provide  sufficient  funding  for  the  NELS  project  to  permit 
inclusion  in  the  follow-up  surveys  of  all  members  of  the 
baseline  sample,    and  to  trace  individuals  who  drop  out  of 
school  or  transfer  from  one  school  to  another.  Tracing 
students  who  transfer  would   permit  an  analysis  of  why  students 
change  schools,   an  important  question  that  we  know  little 
about. 

II.  INPUTS 


fi.  Teachers 
1.  Salaries 

Common  sense,   as  we  1 1   as  the  results  of  research  on  the 
determinants  of  school  effectiveness,   point  to  the  importance  of 
teachers  in  the  education  process.     The  quality  of  the  teachers 
in  Pmerican  schools  depends  on  the  career  decisions  millions  of 
college  graduates  make  about  which  occupation  to  enter,   and  how 
long  to  remain  in  that  occupation.     While  many  factors  influence 
the  attractiveness  of  alternative  occupations,   one  critical 
factor  is  monetary  compensation.      For  this  reason  it   is  important 
to  collect  annual  data  on  the  salaries  of  teacners  rttlative  to 
I  salaries  in  other  occupations. 

The  evidence  that  relative  salaries  affect  the  career 
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decisions  of  teachers   is  not  overwhelming    (to  a   large  extent 


ex ist .     For  example,    studies  have  shown  that  teachers'   mobi 1 ity 
decisions  depend  on  salaries   (eg.    Baugh  and  Stone,  1982). 
Comparison  of  student  test  score  trends  during  the  ISTOs  with 
teacher  salary  tranc's  i3  also  suggsstiv*.     Ov»r  the  period 
1970-1981,   students'    skill   levels  in  the  physical  sciences  fell 
much  more  dramatically  than  skill   levels  in  biology  did.  During 
the  years  1974-81    (the  closest  years  for  whicn  I  could  find  the 
relevant  data),    the  pay  premium  for  a  college  graduate  trained  in 
biology  who  took  a  job  in  business  or  industry  instead  of 
becoming  a  teacher  grew  from  12  percent  of  a  beginning  teacher's 
salary  to  31  percent.     The  comparable  pay  premium  for  a  graduate 
trained  in  physics  grew  from  33  percent  to  S6  percent    (Bacharach  ( 
•t  al.|   1984,   p.  66).     These  patterns  suggest  that  one  of  the 
reasons  for  the  test  score  decline  in  science  was  the  increasing 
difficulty  in  attracting  qualified  science  teachers,   and  that 
this  problem  was  more  acute  for  physical  science  teachers  than 
for  biology  teachers* 


salaries  of  teachers  relative  to  salaries  in  otner  occupations. 
For  example,   should  the  9  or  10  month  salaries  of  teachers  be 
inflated  to  make  them  comparable  with  the  11  or  12  month  salaries 
in  other  professions?     There  is  no  consensus  on  the  answer  to 
this  question,   and  the  attractiveness  of  teaching  salaries  at  any 
one  point   in  time  is  sensitive  to  the  decision.     To  my  mind, 
however,   the  key  value  of  relative  salary  data  lies  in 
comparisons  over  time.     For  examole,    given  that  the  job  of 


because  the  researc'    is  difficult  to  do),   but  evidence  does 


There  are  numerous  Difficulties  in  coiflpiling  comparative 
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teaching   is  quite  different   from  that  of  wording   m  an  industrial 
biology  laboratory,   we  do  not  Wnow  whether  college  graduates 
trained  in  biology  will   find   it  more  attractive  to  take  a  *15,000 
job  teaching  for  10  months,   or  the  11  month  biology  job  that  pays 
12  percent  more.      It   is  reasonable  to  assume,   however,  that 
schools  are  less  able  to  attract  talented  biology  teachers  when 
the  pay  premium  for  working  in  industry  grows  to  31  percent. 
Recommend at  ioni 

Th«  federal  government  should  publish  on  an  annual  basis 
comparisons  of  salaries  in  teaching  with  those  in  other 
occupations.     The  comparisons  should  be  presented  separately  for 
a4»ch  acadsmxc  field.  .  Useful  comparisons  would  be  starting 
salaries,   and  salaries  for  individuals  with  ten  years  of  work 
experience.     Data  on  starting  salaries  are  collected  currently  by 
the  Placement  Center  of  Northwestern  University,   and  are 
published  by  the  National  Educational  Association.  Consequently, 
it  may  not  be  necessary  for  NCES  to  do  all  of  the  data 
collection.     In  fact,    it  may  be  efficient  to  contract  with 
Northwestern  to  collect  comparable  salary  data  for  experienced 
workers.     However  accomplished,   it  is  important  that  annual  data 
be  available  to  assess  trends  in  the  salaries  of  beginning 
teachers  and  experienced  teachers  relative  to  salaries  in  other 
occupations* 

2.      Qualitv  of  the  Tipaghina  Stock 

Has  the  decline  over  the  last  15  years  in  teacr  ing 

salaries  relative  to  salaries  in  other  occupations  led  to  a 
reduction  in  the  quality  of  college  graduates  chcosmg  to  become 
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teachers?     The  evidence  on  the  average  SfiT  scores  of  new  teachers 
suggests  that  this  is  the  case.     fis  Vance  and  Schlechty  (1982) 
have  documented,   these  scores  have  fallen  quite  dramatically  in 
recent  years. 

To  my  mind,    it   is  important  to  collect  data  on  the  SPT 
scores  of  college  graduates  who  enter  teaching.     The  reason  is 
that  this  gives  an  indication  of  how  bright  college  graduates 
perceived  the  attractiveness  of  teaching  relative  to  that  of 
other  occupations.      I  want  to  point  out  that  several  members  of 
the  Committee  on  Indicators  of  Precollege  Science  and  Mathematics 
Education  disagree  with  this  suggestion.     They  argue  that  there 
is  no  evidence  indicating  that  a  teacher's  SPT  score  is 
correlated  with  teaching  effectiveness.     filso,   not  all  college 
graduates  who  enter  teaching  have  taken  the  SfiT.  Consequently, 
it   is  not  clear  what  the  scores  are  telling  us. 

I  believe  that  the  criticisms  of  my  fellow  Committee 
members  are  important.     On  the  other  side,  however,    I  think  about 
the  hard  questions  state  legislators  will  a$k  Chief  State  School 
Officers  in  the  coming  years  about  whether  the  large  increases  m 
teacher  salaries  that  many  legislatures  are  passing  have 
influenced  the  success  of  public  schools  in  attracting  talented 
college  graduate?  to  teaching.     To  my  mind,   SflT  score 
information,    if  presented  carefully,   could  help  us  in  answering 
the  legislators'  question. 
Recommentfat  ions i 

1.   NC£S  should  attempt  to  collect   information  on  the  SAT  scores 
of  colleqe  graduates  entering  teaching.       This  •ffort  will 
probably  require  significant  collaboration  with  state  teacner 
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certification  agencies.      It   is  important  that  the  information 
pertain  to  college  graduates  who  actually  become  teachers, 
rather  than  college  freshmen  who  indicate  that  they  plan  to 
become  t eacher^^-^these  are  quite  different  groups. 
The  statistics  that  should  be  reported  are  not  tne  average  SOT 
acorea  of  graduates  who  become  teachers,   but  rather  the 
percentage  of  teachers  who  have  SflT  scores  above  a  soecific 
cutoff — for  example,   450  on  the  verbal  test.     The  reason  is 
that  the  critical   information  tne  data  conveys  is  the  ability 
of  the  schools  to  attract   literate  college  graduates. 
Percentage  of  teachers  with  scores  above  a  cutoff  point 
conveys  this  information  more  accurately  than  the  average 
score  of  teachers  does. 

It  is  imoortant  to  compare  the  percentage  of  teachers  scoring 
above  a  cutoff  point  with  the  percentage  of  all  individuals 
taking  the  test  in  that  year  who  scored  aoove  the  cutoff 
point.  The  reason  is  that  the  overall  SflT  score  distribution 
Changes  from  year  to  year,  and  it  is  necessary  to  compare 
teachers*  scores  with  those  of  other  students  who  took  the 
test  to  judge  hoM  successful  our  schools  have  been  in 
competing  for  talented  college  graduates  in  a  particular  year. 
It   is  important  to  keep  track  of  changes  in  the  composition  of 
the  pool  taking  the  SflT  so  that  the  effects  of  such  changes  on 
the  test  score  distribution  can  be  separated  from  cnanges  in 
the  ability  of  the  pablic  schools  to  attract  talented  college 
graduates. 
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3.      Teacher  rnobx  1  xtv  patterns  and  what   they  mean 

The  chart  on  page  Z7  of  tne  NCES  publication,    Ind  icat ors 
of  Education  Status  and  Trends   (1985),    is  provocative.      It  shows 
that  the  SPT  scores  of  individuals  who  left  -^sacning  after  a  few 
years  are  higher  on  average  than  the  sco\        of  veachers  who 
remained   in  the  classroom.      How  snould  we  interpret  this 
information?     Was  this  pattern  different  twenty  years  ago*^  fire 
there  policy  changes  that  might   alter  this  pattern?     Would  higher 
salaries  enable  school  districts  to  retain  teachers  with  high 
academic  ability?     We  simply  do  not  know.      It  may  be  that 
teacners'   decisions  about  how  long  to  remain  in  the  classroom  are 
sensitive  to  salaries.      It   is  also  possible  that  many 
academically  t   lented  college  graduates  plan  to  teach  for  a  few 
years,   and  than  move  on  to  a  new  challenge,   such  as  law  school, 
and  that  these  plans  would  not  be  altered  by  moderate  changes  in 
teacn«r  salaries. 

To  interpret  descriptive  patterns  such  as  the  one 
presented  on  pas«  27  of  Indicators  and  to  inform  policy 
discussions  about  how  to  attract  and  retained  talented  college 
graduates  into  teaching,   we  need  to  learn  more  about  the 
determinants  of  teachers'  career  decisions*     We  ;;lso  need  this 
Information  to  Impr^ave  the  models  that  are  used  to  predict 
teacner  shortages  and  surpluses.     To  my  knowledge,    in  no  existing 
model  of  the  teacher  labor  market    (and  I   include  the  NCES  model 
in  this  category)    is  the  supply  of  new  entrants  or  the  turnover 
rate  viewed  as  being  sensitive  to  salaries*     This  is  ironic  In 
the  sense  that   increases  in  teacher  salaries  are  a  common  theme 
in  the  wave  o^  current  school  reform  legislation  aimed  at  coping 
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with  ths  shortages  predicted  by  the  demand  and  supply  models. 


career  patterns?     One  reason  is  that  research  on  this  set  of 
issues  requires  data  on  the  career  decisions  teachers  make  ovpr 
time  and  on  the  attributes  of  their  options.     Little  such  data 
exist,    although  there  are  opportunities  to  create  more  at 
reasonabls  cost. 
Recommendat  ions ! 

1.   Continue  follow-up  surveys  of  the  NLS72  sample.   Manski  (1983) 
has  identified  SlO  individuals  in  that  sample  who  became 
teachers.     One  of  the  many  benefits  of  following  this  sample 
as  its  memderb  age  is  that  we  could  study  why  some  teachers 
remained  in  the  classroom  and  others  did  not.     It  would  be 
valuable  in  future  follow-up  surveys  to  include  questions 


about  the  reasons  for  occupational  changes,  and  at  out  salaries 
before  and  after  job  changes. 

2.  NC£S  should  ask  Manski,   Schlechty,   and  other  researchers  wno 
have  studied  teachers'   careers  with  the  NLS72  data  about  how 
the  HS4B  and  NELS  follow-up  surveys  could  be  structured  to 
overcome  limitations  of  the  NLS72  data  for  studying  this  set 
of  issues. 

3.  The  Current  Population  Survey   (CPS)   has  a  limited  longitudinal 
component  that  can  be  used  to  examine  the  reasons  teachers 
change  jobs.     Baugh  and  Stone  (1982)   have  used  CPS  data  to 
show  that  teachers'   decisions  about  whether  to  change  jobs  are 
sensitive  to  salaries.     My  sense  is  that  more  could  be  learned 
f^om  CPS  data  about  the  determinants  of  teachers'  career 
decisions   (as  well  as  the  career  decisions  of  workers  in  otner 
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occupations)    if  more  attention  to  this  set  of  questions  was 

( 

given  in  the  design  of  questionnaire  items.      I   encouV^age  NCES 
to  work  with  tne  Census  Bureau  in  exploring  the  possibility  of 
using  the  CPS  surveys  to  learn  more  about  teachers'  career 
paths,    and  specifically  about  the  reasons  for  job  changes. 


B«  Capital  Accounts 

NCES  collects  a  significant  amount  of  information  on  the 
caoital  axpondituros  of  local  school  districts.     There  is  no 
question  that  the  quality  of  the  physical  plant   influences  the 
quality  of  lif»  for  teachers  and  students  in  local  school  ( 
districts  and  that  the  cost  of  the  physical  plant  is  a 
significant  burden  on  many  school  districts.     There  is  a  question 
in  my  mind,   however,   about  the  usefulness  of  the  data  that  NCES 
collects  on  capital  account  expenditures.     I  have  nsver  seen  a 
study  that  uses  these  data  in  a  manner  that   improves  our 
understanding  of  how  U.S.  education  works. 
Reeemmendat  ion 

NCES  should  explore  whether  the  data  it  collects  on  capital 
account  expenditures  are  used,   and  if  so,   whether  the  uses 
justify  the  cost  of  collecting  and  processing  these  data. 
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III.    PRIVATE  SCHOOLS 

( 

What  rolos  do  nonpuolic  schools  play  in  educating 
American  children?     In  recent  years  research  by  James  Coleman 
(1982)   and  others  using  the  HS&B  data  has  increased  our  knowledge 
of  the  roles  that  certain  types  of  nonpublic  schools,  especially 
Catholic  schools,    play.     We  still   know  very  little  about  other 
nonpublic  schools,   however.      I  focus  my  attention  on  two  types  of 
nonpublic  schools  that  may  be  playing  an  increasing  role  in 
American  education:  private  schools  as  an  after-hours  complement 
to  public  schools,   and  fo\ — profit  private  schools. 


A.   After-Hours  Private  Schools 

A  recent  article  in  the  New  York  Times  reported  that  an 
increasing  number  of  American  children  are  attending  private 
schools  after  regular  school  hours  to  supplement  the  instruction 
they  receive  in  public  schools.      If  this  is  indeed  the  case,  then 
It  introduces  a  new  determinant  of  the  skill  distribution  of 
American  students,   and  another  mechanism  through  which  affluent 
families  can  provide  for  their  children  better  education  than 
that  provided  to  children  from  poor  families.      (In  Japan,  private 
after-hours  schools,   called  Juku,   are  an  important  mechanism 
through  which  middle  class  families  ^rB^ArB  their  children  for 
the  national  exams  that  determine  entrance  to  public 
universities;  see  Cummings,    ISflO  for  more  on  Juku.)     Little  is 
V  known  about  after-hours  private  scnools  in  the  U.S.,   and  it  seems 

worthwhile  to  try  to  learn  more  about  them. 
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Recommendat  ions ;  ^ 

1.  In  the  design  of  the  rew  lonsitudinal  stucy  of  Pmerican 
students   (NELS) ,    include  a  set  of  questions  asking  whether 
students  do  attend  after-hours  schools,    and   if  so,    what  the 
schools  do  and  what  they  cost. 

2.  Include  a  similar  set  of  questions  in  tne  October  CPS  survey. 

B.   For-Profit  Schools 

The  1377  Census  of  Service  Industries  reoorted  the 
existence  of  2237  foi — profit  elementary  and  secondary  schools  in 
the  U.S.     These  schools  were  very  small,    paid  their  teachers  low 
salaries,   and  were  disproportionately  located  in  the  South.  0 
recent  New  York  Times  article  reported  that  the  numoer  of  ( 
foi — profit  schools  is  growing.     The  article  described  a  number  of 
relatively  expensive  fo\ — profit  scnools  serving  students  from 
upper  middle  class  families.     This  descriotion  seems  different 
from  the  very  limited  description  of  for-profit  private  scnools 
that  can  be  gleaned  from  the  1977  Census  of  Service  Industries. 

It  would  be  worthwhile  to  learn  more  aoout  the  number  of 
foi — profit  elementary  and  secondary  schools  in  the  U.S.,  where 
they  are  located,   what  tuitions  they  charge,   and  whom  they  serve. 
Once  we  know  the  answers  to  these  questions,   we  could  explore 
whether  for-profit  scnools  ooerate  differently  from 
not-foi — profit  schools.   This  would  be  valuable  in  thinking  about 
the  design  of  state  regulations  of  private  schools,  and  the 
design  of  voucher  systems — tooics  of  increasing  interest   in  many 
^  states.  370 
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Rgcomrnerdat  lors; 

1.  Include  questions   in  the  next   Census  of  Service  Industries 
that  will   provide  information  about  for— profit  schools. 

2.  Explore  wr. ether  it   is  possible  to  use  IRS  data  to  learn  about 
trends  in  the  number  of  for-profit  schools,   their  locations, 
and  their  scale  of  oaeration. 

IV.    CONCLUDING  COMMENT 


I  would  like  to  exoress  my  suaport   for  the  process  NCE3 
has  initiated  in  attpmpting  to  improve  the  quality  o^  federal 
statistics  on  elementary  and  secondary  education.     Asking  a  large 
number  of  individuals  from       f ferent  backgrounds  for  their  ideas 
is  essential  to  improving  NCES' s  contribution  to  understanding 
U.S.   education.      It   is  also,   however,   an  invitation  to  criticisms 
from  many  fronts.      I  admire  the  decision  of  the  NCE5  leadersnis 
to  solicit  suggesticns  with  the  inevitable  accompanying 
criticisms  and  the  decision  to  make  all  of  the  suggestions 
public.     I  look  forward  to  reading  the  suggestions  of  other 
comment  at  cir^. 

I  conclude  my  comments  with  one  final  suggestion,     Ps  the 
NCES  staff  wades  through  the  many  sets  of  suggestions,    it  is 
inevitable  that  many  suggestions  cannot  be  implemented  because  of 
their  cost,    because  of  the  politics  of  education  in  our  federal 
system,  and  for  a  variety  of  other  reasons.     While  most  users  of 
NCES  statistic?  are  acutely  aware  of  their  limitations,   many  are 
not  aware  of  the  reasons  certain  tyoes  of  data  are  not  collected. 
Producing  a  document  that  attemots  to  explain  these  reasons  could 


be  very  informative.      It    is  also  possible  that   a  statement  of  the 
reaons  why  potentially  valuable  data  are  not  col lected ' could  lead 
to  Changes  in  thm  budgetary  or  political  conditions  that 
prevent  the  data  collection. 
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Products  and  Processes  of  Che  National  Center  for  Education  Statistics: 

An  Agenda  for  the  Next  Decade 


Introduction 

This  review  of  the  current  data  collection  activities  of  the  National 
Center  for  Education  Statistics  is  divided  into  two  major  sections.  Tne 
first  section  presents  a  set  of  eight  major  recomDendations  that  apply  to 
NCES  plans  in  general.    Although  these  general  reco&aendations  carry  seme 
implications  for  specific  data  collection  activities,  the  emphasis  if  on 
the  general  netds  for  covtragt  in  ntv  content  areas  and  the  development  of 
new  processes  to  involve  and  aerve  users  of  NCES  data.    The  second  section 
of  the  paper  reviews  each  NCES  data  collection  activity  and  presents  very 
specific  suggestions.    In  some  cases,  the  general  arguments  identified  in 
the  first  section  are  illustrated  by  specific  suggestions  in  the  second 
section. 

Section  I ;    General  Recomendations 

The  general  reconaendations  for  future  NCES  data  collection  activities 
are  of  two  types.   The  first  five  recommendations  deal  with  the  content  of 
current  and  new  data  collection  activities.    These  recommendations 
typi::ally  concern  educational  phenomena  that  are  likely  to  become 
increasingly  important  to  educational  policy  makera  in  the  years  ahead. 
Cher  recomendations  deal  with  the  processes  by  which  education  statistics 
are  collected.    Such  proceases  have  an  impact  on  both  the  quality  of  the 
data  that  is  collected  and  on  the  utility  of  that  data  to  potential  users. 
These  process  recoosaendations  imply  a  greater  leadership  role  for  NCES  in 
orguniging  education  data  collection  activities  nationwide.    They  auggest 
not  only  a  variety  of  ways  in  which  NCES  itself  can  collect  data  on 
educational  procesaes,  but  alao  maya  in  which  NCES  can  guide  and  coordinate 
the  data  gathering  activities  of  others  ao  that  they  can  be  employed  in 
analyses  of  educational  activities  on  a  nationwide  acale. 

tecommendation  1;   Jjgl^  gjffiuld  fanlicitlv  CoflAiA«^  MoviM:  lOflM 
Collection  of  Data  on  Schooline  to  the  Collection  of  Data  on  Edu^fU?" 

Host  current  NOES  data  collection  activities  focus  on  elementary  and 
secondary  scboola.    While  achooling  should  remain  at  the  core  of  NCES  data 
collection  plana^  greater  attention  should  be  devoted  to  educational 
activities  that  extend  beyond  formal  acbools.    Such  greater  attention  is 
necessary  for  two  reasons.    First r  non«-acbool  educational  experiences  are 
playing  an  important  role  in  the  lives  of  young  Americans  (Cremin,  1976; 
Leichteri  1975).    Student^  ere  being  exposed  to  a  greater  variety  of 
educational  phenomena  than  ever  before  from  the  mass  mecia  (Cans,  1967; 
Lieberti  Neale,  and  Davidaon,  1973;  Leaaer,  1974)  to  educational  software 
and  other  new  information  technologies  (Smithf  1982)|  to  aupplementary 
instruction  in  the  growing  number  of  propriety  acbools  and  tutoring 
services  (Martin  and  HcCartney.  1976).     VhiU  we  may  not  yet  be  in  the  age 
of  lUich's  (1971)  learning  networks^  atudents  are  being  exposed  to  a 
growing  number  of  learning  resources  outside  of  the  traditional  schools. 
While  the  public  schools  4re  available  to  all  and  while  we  have  spent 
considerable  time  and  effort  to  attempt  to,^,^re  equal  educational 
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opportunity,  we  know  very  little  about  the  distribution  of  non-school 
educational  resources. 


A  second  reason  for  paying  attention  Co  Che  growing  set  of  educacional 
resources  ouCaide  of  Cradicional  schools  is  Co  inprove  our  understanding  of 
the  effects  of  schools  Chemselves.    If  scudencs  and  cheir  parents  are 
cooing  Co  rely  increasingly  upon  non-school  educational  activities  for  the 
development  of  inportanc  skills  and  abilities,  it  will  be  impossible  to 
understand  the  true  effects  of  schools,  public  or  private,  without  good 
information  on  the  other  educational  resources  available  to  students. 
Moreover,  if  more  economically  able  parents  secure  these  outside 
educational  resources  at  higher  rates  there  is  a  danger  of  attributing  to 
ascriptive  characteristics,  affects  that  should  be  attributed  to  organized 
educational  activities  outside  of  public  and  private  schools.  Non-school 
educational  activities  may  become  important  control  variables,  much  like 
parent  educational  levels  and  economic  resources,  in  understanding  the 
effects  of  schooling. 

Dnlike  public  and  pri  ate  full-time  day  schools,  non-school 
educational  resources  may  be  difficult  to  identify.    Several  strategies  may 
be  necessary  to  develop  data  on  these  educational  activities.    First,  it 
would  be  useful  to  include  items  on  regular  NCES  surveys  of  students  and 
parents  (e.g..  High  School  and  Beyond)  which  request  respondents  to  report 
on  the  extent  of  thtir  participation  in  non-school  educational  activities. 
A  preliminary  list  of  such  activities  vould  include:    private  lessons  in 
music  and/or  art,  privatt  instruction  in  sports  and  other  physical 
activities  (e.g.,  tennis,  horseback  riding),  participation  in  a  computer 
uaers  group,  training  related  to  a  part-time  job,  attendance  at  an  SAT  or 
ACT  test  preparation  course,  remedial  or  supplementary  instruction  in  one 
or  more  school  courses,  and  training  provided  by  a  youth  or  community  group 
such  as  the  TMCA  or  the  Boy  Scouts  or  Girl  Scouts.    This  strategy  vould 
permit  analyses  to  determine  the  extent  to  vhicb  individual  students 
participate  in  non-school  educational  activities  and  the  impact  of  such 
participation  on  student  performance  in  school  classes  and  on  standardized 
tests.   Analyses  could  also  be  conducted  to  determine  the  access  to  such 
supplementary  educational  resources  of  students  vith  differtnt  family  and 
background  characteristics. 

A  second  strategy  for  collecting  information  on  non-achool  educational 
activities  vould  be  to  identify  the  population  of  educational  service 
providers  through  state  corporate  records.    Many  supplementary  educational 
activities  are  provided  by  private  businessesii  yet  the  education  community 
and  education  policymakers  have  little  current  information  on  vhat  «ay  be 
the  fastest  groving  part  of  the  educational  sector.    A  census  of  such 
organisations  vould  begin  to  fill  this  gap  in  our  knovledge. 

A  third  strategy  for  collecting  information  on  the  <<xtent  of  nonschool 
educational  activities  vould  be  to  identify  a  representative  sample  of 
communities  and  survey  the  available  non-school  educational  programs 
available  in  the  community.   This  strategy  vould  permit  analyses  to 
determine  the  distribution  of  supplementary  educational  activities  across 
cosDunities  vith  different  demographic  and  economic  characteristics. 

The  point  of  all  of  these  data  collection  activities  vould  be  to  begin 
to  understand  the  extent  to  vhich  non-school  educational  activities 
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experiences  prior  to  high  school,  o  i         'ot  experiences  outside  of  high 
school  (e.g.  TV  viewing),  and  on  stud^^nt  expectations  for  education  and 
occupational  attainnent  after  high  school  (e.g.,  plans  for  post-secondary 
education),  it  contains  virtual ly  nothing  about  the  processes  that  students 
currently  experience  in  the  school.    The  absence  of  these  indicators 
severely  Units  the  use  to  vhich  educational  researchers  can  put  such  a 
data  se". 

Social  scientists  (Sorersen  and  Hallinan,  1977;  Barr  and  Dreeben, 
1983)  have  recently  directed  attention  to  school  processes,  renewing  an 
interest  that  characterired  studies  of  schooling  of  the  fifties  and  early 
sixties  (Gordon,  1957;  Coleman,  1961;  McDill,  1969;  McDill  and  Rigsby, 
1973).    Educators  have  placed  additional  emphasis  on  what  schools  can  dc  to 
make  a  difference  in  the  lives  of  students  (Walberg,  1984).    Yet,  the  High 
School  and  Beyond  Study  attaa  to  treat  the  achool  itaelf  like  a  black  box 
into  vhich  student  characteristics  are  poured  and  out  of  vhich  student 
expectations  and  occupational  experiences  f lov. 

Ao  effort  should  be  aade  to  identify  key  achool  processes  and  include 
indicators  of  such  processes  in  future  studies  of  schooling.  Such 
processes  night  include:    performance  evalvation  (Entvisle  and  Hayduk, 
1981;  Rosenholta  and  Simpaoa,  1984;  Natrie!  lo,  1982;  Matriello,  1984; 
Natriello  and  Dornbuscb,  1984),  rules  and  procedures  (HcPartland  and 
McDill,  1977;  (tottfredson  and  Daiger,  1979),  peer  netvorka  (Coleman,  1961; 
Hallinan  and  Tuma,  1978;  Epstein  and  Karveit,  1983),  group  processes 
(Sharan,  1980;  Sharan,  Hare,  Webb,  and  Bertz-*Uzarovits,  1980;  Slavin, 
1980),  instructional  strategy  (Good,  Ebmeier  and  Beckerman.  1978;  Good, 
1983),  time  on  academic  tasks  (Karveit,  1983;  Karveit,  1984),  Md  atandards 
for  performance  (Matriello  and  Dornbuscb,  1984;  Natriello  and  McDill, 
forthcoming).    Becent  surveys  such  as  the  National  Institute  of  Education's 
Safe  Schoul  Study  (National  Institute  of  Education,  1977)  and  Good  lad's  A 
Study  of  Schooling  (1983)  might  be  used  as  initial  sources  for  items 
relating  to  school  processes. 

Recommendation  NCE8  Should  Oreaniae  lh£  yvstenatic  Collecf ion  sd  Data  fin 
Student  Performance  fi£  Emn lover  Sponsored  Teats. 

One  ultimate  outcome  of  schooling  proceaaea  it  atudent  performance  in 
the  vork  place.   From  time  to  time  there  have  been  varioua  reports  of  hov 
recent  graduatea  have  fared  on  the  performance  testa  adminiatered  by  major 
employers.   At  times  employers  have  pointed  to  the  lack  of  atudent 
proficiency  in  baaic  communication  and  computation  akilla.    Such  charges 
are  often  aaid  to  be  baaed  on  atudent  performance  on  atandardised  teats 
used  by  major  tmployera  to  acreen  potential  employees.    Closer  analytes  of 
the  reactiona  of  major  employers  to  recent  graduatea  (Levine,  1984)  have 
auggested  that  the  major  deficiency  of  employeea  liea  mot  in  the  area  of 
baaic  akilla  but  in  the  area  of  attitudea  tovard  vork  and  deportment. 

In  any  caae,  employera  are  increaaingly  involved  in  collecting  data  on 
the  performance  of  recent  high  achool  graduat^es  (Committee  on  Ability 
Teating,  1982,  chapter  4).    NCES  sight  capitaliae  on  thia  trend  by 
organixing  and  aggregating  thia  data  on  the  performance  of  recent  graduates 
from  a  representative  aample  of  wjor  employers.    Major  aources  of  «uch 
data  include  the  armed  forcea  (The  Armed  Servicea  Vocational  Aptitude 
Battery  -  ASVAB  >  ia  the  moat  uaed  employment  teat.),  the  civil  service, 
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•tate  and  local  governnenCai  private  sector  employers,  and  various 
professional  associations.    Thus»  performance  data  on  recent  traduaces  is 
being  collected  by  a  large  nuaber  of  employers  across  the  nation.  Wt'at 
remains  to  be  done  is  the  assembling  of  a  carefully  drawn  sample  of  such 
information  and  systematic  tracking  and  interpreting  of  the  results  of  such 
tests  over  time.    NCES  might  organize  such  an  effort. 

Recommendation  5:    HCES  Should  Devote  Greater  Attention  to  thos^ 
Ei^ucational  Organizations  that  Serve  Pre-school  Youngsters. 

While  NCES  currently  collects  data  on  the  universe  of  public 
elementary  and  secondary  schools  vith  sample  studies  of  private  schools,  it 
devotes  relatively  little  attention  to  institutions  serving  the  pre-*school 
youngster.   ▲  notable  exception  is  the  survey  of  pre-priaary  enrollments 
using  census  data.    Efforts  should  be  made  to  work  vith  appropriate 
agencies  in  the  various  states  to  collect  data  on  the  population  of  child 
care  and  early  education  institutions  serving  youngsters  from  birth  to 
kindergarten.    We  have  relatively  little  systematic  national  information  on 
this  rapidly  growing  sector  of  educational  institutions.    Such  data  would 
appear  to  be  important  for  two  reasons.    First,  in  recent  years  there  has 
been  increased  concern  about  the  basic  physical  safety  of  children  in  such 
institutions.   This  has  given  rise  to  a  more  general  concern  for  the 
overall  quality  of  these  programs.'   Second,  ve  have  a  great  educational 
opportunity  that  may  be  missed  if  such  institutions  are  not  identified  and 
encouraged  to  promote  the  educational  growth  of  young  children.  States 
should  be  encouraged  to  monitor  such  institutions  and  develop  appropriate 
policies  to  insure  that  their  educational  potential  is  realised.   As  more 
and  more  women  enter  the  work  force  full  time,  the  role  of  such 
institutions  in  the  O.S.  is  likely  to  become  more  important. 

Recommendation  6;    jl£££  jbsiOi  Zttl  i&  I1J££  1  £lfi££^ 

Urge-Scale  Data  Collection  Efforts       ^  linkgj  i^tli  Mgll  M^9T9-Uvt  ^ 

Studies 

In  the  foreseeable  future  it  is  likely  that  only  the  federal 
government  will  be  able  to  mount  educational  research  projects  involving 
the  collection  of  large  nAtionally  representative  data  sets.   Yet  many  new 
and  interesting  theoretical  ideas  and  most  richly  textured  studies  of 
educational  phenomena  are  developed  by  individual  investigators  or  small 
teams  of  investigators  working  in  a  small  number  of  schools  with  severely 
limited  research  budget s^    If  the  large-scale  data  collection  efforts  of 
NCES  are  to  profit  from  and  enrich  the  work  of  most  educational 
researchers.  HCES  will  have  to  put  in  place  a  process  to  ensure  that 
linkages  can  be  made  between  its  macro-level  data  collection  program  and 
micro- level  investigations. 

Vhile  a  variety  of  strategies  can  be  employed  to  establish  and 
maintain  this  link,  the  following  would  seem  to  be  the  minimum  required: 

1)  Develop  clear  and  widely  announced  procedures  for  submitting 
items  for  HCES  surveys. 

2)  In  considering  items  for  inclusion  in  RCES  data  collection 
efforts,  those  items  which  have  been  used  successfully  in 
small  scale  studies  should  be  given  priority  over  those 
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items  vhich  have  not  been  proven  in  snail  scale  studies. 

3)  NCES  should  convene  a  panel  to  develop  a  set  of  critical 
indicators  of  each  level  of  schooling  that  might  be  used 
to  describe  school  sites  employed  in  small  scale  studies 
so  that  the  educational  research  community  can  develop 

a  clearer  sense  of  the  nature  of  the  sites  in  vhich  small 
scale  studies  are  conducted. 

4)  NCES  should  work  closely  with  the  appropriate  National 
Institute  of  Education  Research  and  Development  Centers  and 
Regional  Educational  Uboratories  to  coordinate  nationwide 
surveys  with  the  on-going  vork  of  these  major  government 
sponsored,  educational  research  institutions. 

Recomiendatioa  IL   NCES  Should  Itork  wilh  A 

State  L£vel         MMMMk  R«l&t^  iS.  Significant  Educational  Issan, 

It  is  becomming  increasingly  clear  that  the  state  is  the  level  at 
which  much  educational  policy-making  takes  piece  and  will  " 
place  in  the  future.    With  this  in  mind  WCES  should  take  a  leadership  role 
in  developing  model  state  level  data  bases  in  areas  of  ..  , 

educational  concern.   For  e««.ple.  the  current  interest  in  the  "Ixbr.  of 
the  teaching  corps  is  a  crucial  issue  in  education,  and  one  that  is  not 
/  likely  to  go  away.    NCES  has  responded  by  developing  a  survey  ^er 

V  demand  and  shortage  using  a  nationally  representative  sample  of  LEA  s  and 

private  schools.    While  NCES  should  be  commended  for  responding  to 
increasing  concern  about  the  teaching  force,  the  chief  policy  options  to 
iS^ove  t'he  teaching  force  are  at  the  state  lev«l  (United  S".^" 
of  Education,  1984).    Therefore,  it  would  be  far  .ore  appropriate  for  NCES 
to  work  with  a  few  individual  states  to  assist  them  in  developing  state 
level  data  bases  relevant  to  this  issue. 

A  two  stage  process  ahould  be  initiated,    in  the  first  stage  HCES 
would  identify  several  states  interested  in  developing  a 
base  relevant  to  state  policy  -king.   HCES  would  then  work  ''"J  'Jes. 
SEA'S  to  develop  the  data  gathering  procedures.    In  the  second  «J8«  ^J" 
might  select  th'e  most  auccesstul  data  base  design  and  use  V,".^^; 
lor  .  national  data  base  assembled  from  data  collected  by 
states.    Other  SEA's  would  be  asked  to  develop  the  designated  state  level 
data  bases. 

There  are  several  advantagea  to  tach  an  approach.  First,  state  level 
data  bases  would  insure  that  the  data  gathered  is  at  the  appropriate  level 
of  ng"egation  for  policy  -king.  Second,  «CES  could  provide  a  l«*<!"»hip 
Jole  in  helping  staJe  departments  of  education  to  develop  the  "P.city  for 
lollectinR  and  interpreting  educational  data.  Third,  NCES  could  develop 
national  dat?  s."  iith  a«5se  assurance  that  Che  actual  data  col  lection  was 
"s^ful  lo  the  dat;ceU.ctora  (SEA's)  and  that  the  data  collection  was  done 

properly. 
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Reeomendatioa  ii.    NCEj  Shoujd  Maintiin  an  Avareness  of  l^tn^ 
Techno loaieTfor  the  Transnission  and  CoTanunication  of  Data  to  Helevaiit 
Croups  of  Users . 

While  the  program  of  publications  and  computer  data  tapes  now  used  by 
NCES  has  met  the  needs  of  many  data  users,  nCES  ... 
awareness  of  new  technologies  for  data  transmission  and  communication  with 
«levant  users  of  its  products.   Although  it  is  impossible  to  "ticipate 
future  developments  in  this  area,  aeveral  currently  available  technologies 
.uSJ  offer  increased  access  and  ease  of  use  for  NCES  data.    These  mcUde: 

1)  Establishment  of  an  on-line  query-based  information  system  to  access 
HCES  data.    Such  a  ayat«m  could  be  developed  independently  or  in 
conjunction  with  a  general  information  utility  auch  aa  The  Source  or 
Compuserve.    There  ia  already  evidence  of  the  growing  use  of  such 
information  acrviccs  by  educational  researchers  and  the  general 
public  (Pierce  and  Coo  ley,  1985). 

2)  The  production  of  HCES  data  in  new  forms  auch  aa  floppy  disks  for  use 
on  microcomputers.    Microcomputers  are  moving  quickly  into 
universities,  SEAs  and  LEAs,  and  educational  policy  agencies.  NCES 
eight  increase  the  utility  of  much  of  ita  data  to  a  wide  variety  of 
uaers  by  making  it  available  in  micro-readable  formats. 

3)  NCES  Bbould  develop  a  comprehenaive  program  to  make  the  research 
comunity  sdrc  aware  of  its  activities  In  the  collection  and 
processing  of  education  data.    The  program  of  *»*«"*"?^ 
activities  and  curriculum  materiala  developed  for  the  1980 
Census  provides  aomt  good  examples  of  techniques  that  could  be 
uaed  b;  NCES. 

faction  111  ££i£ili£  S££i  AsiixUiii 

The  commenta  In  this  Mctlon  r*gard  apecific  NCES  data  colltction 
activities.   All  of  these  comenta,  both  tboae  pertaining  to  existing  items 
icis  au;veya  and  thoa*  r.co-ended        lt«s,  are  »»"«*  - .J^*  J'/^tJ  , 
of  NCES  materlala  providad  for  thia  review.    They  do  not  reflect  any  other 
NCES  activltiea. 

I.  Camon  Core  st  filU  iSSSl 

The  Common  Core  of  Data  teems  adequate  to  provide  basic  inforMtion  on 
the  uSleraH?  public  achoola  and  achool  diatricta  in  the  United  States. 
I  have  only  three  auggestiona  In  thii  area. 

firat,  the  local  Education  Agency  Honfiacal  Report  """'i^  '•^""ii 
a  report  ol  only  thoat  progr«aa  that  are  part  of  the  regular  achool  system 
Ind  that  are  financed  by  the  local  education  agency  or  other  public 
SJcation  unit    U  order  to  underatand  the  extent  to  which  the  pub  Uc 
IchoSla  Ire  Involved  (even  without  providing  financial  aupport)  w,th  a 
variety  of  new  educational  aervlcea  auch  aa  da;f-care  for  young  children  or 
Extended  day  programs  for  latch-key  children,  it  would  be  important  to 
Mfl".ri"fJrLtion  on  programs  affiliated  with  each  public  school,  even 
IJJm  ibicb  alJply  ua.  Ibi'physical  facilities  of  the  public  schools. 
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Second,  respondents  are  allowed  to  designate  the  beginning  of  the 
range  of  Che  educational  program  as  pre-kin^ergarten  or  kindergarten.  It 
would  provide  more  useful  data  on  educational  programs  for  very  young 
children  to  have  designations  related  to  the  age  of  the  child. 

Third,  the  current  procedure  for  calculating  student  membership 
assumes  that  names  of  students  on  the  rolls  are  automatically  dropped  after 
a  specified  number  of  days  of  consecutive  absence.    Yet  there  is  no 
standard  specification  of  the  number  of  days  after  which  students  should  be 
dropped.    As  a  result»  different  district  level  practices  may  result  in 
quite  different  reported  enrollment  levels.    NCES  should  adopt  a  standard 
for  retaining  students  on  the  rolls. 

II .  Sample  Surveys 

The  comments  on  the  NCES  program  of  sample  surveys  pertain^  for  the 
most  part»  to  specific  survey  items.    These  comments  are  organized  in  teres 
of  the  six  current  surveys  conducted  by  NCES. 

Private  School  Survey 

The  following  items  on  the  private  school  survey  seem  worthy  of 
additional  attention: 

a)  On  page  6|  quest lOO  14>  rtspoodenti  might  be  asked  to  note  the  amount 
of  funds  available  for  financial  aid  during  the  current  academic  year. 

b)  On  page  7»  question  15»  respondenta  might  be  asked  to  report  on 
programs  offered  primarily  to  extend  the  acbool  day  and  uaed  by 
working  parents  for  child  care  purpoaes. 

c)  On  page  10,  question  19,  respondents  might  be  aaktd  whether  this 
school  restricts  admission  on  the  basis  of  membership  in  a  religious, 
cultural,  or  language  group.    If  the  answer  is  yes,  they  might  be 
asked  to  note  the  nature  of  the  restriction. 

d)  On  page  10,  respondents  sight  be  asked  to  report  the  percentage  of 
initial  applicants  to  this  school  that  are  finally  admitted. 

e)  Respondents  should  be  asked  to  report  the  name  of  the  public  school  or 
schools  to  which  students  in  this  school  would  normally  be  assigned. 
This  information  can  then  be  further  identified  with  the  NCES  school 
code.    This  item  might  be  included  in  a  future  aurvey  of  parents. 


Public  School  Survey 
Administrator  Survey 

a)  It  would  be  uaeful  to  Include  a  set  of  items  on  this  survey 
that  parallel  tboae  on  the  private  school  aurvey.    For  example^ 
the  questions  on  incentive  systems  could  be  included  in  both 
surveys. 

O  b)  Question  23  on  na&e  4  tbould  be  deleted.^  It  asks  for  the 
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b)  QutscioD  23  oa  pn*  ^  »bouU  bt  dtltct4j    It  • 

'  '  000 


.doiniitr.tor'i  opinion  regarding  curriculum  requireoenti 
:f  ini:Ji:tien  en'curr.nt  requirement,  is  requested. 


when 


Teacher  Survey 

.ctivities  ie'utrne  id.,  vh.t  kind  of  instruction 

instructional  •ctxvxtitt.    «  J'^*  "°  j^^,  continues  an  HCER 

requirement I. 
Recenl  Sutm  fii  Crfiduit^ 

with  itudent  respotiiti. 

the  reiulti  for  pUnning  purpose! . 
Hith  School  ifil  ''VOP^ 
SophoBore  Fir it  Follow-Op 

.,  H.,.  d.t.ii«.  ,...ti».     'riwii  'luSmt' '.bJiid 

A  follov-nip  to  qutition  4  on  page 
C«k<  •  count.    8..  GKtt  .iKl  l>«UBy  (19B5). 

for  cxaaplci. 

on   01    »d  92  ihould  be  deleted.    The  infor»*tion  on 

d)  »...ti..  X2S.i,ht  c..t.l.  .  r..po...  e.tn.r,  for  .p.ci.l  «U.». 
tuodi  •ittbXiiktd  by  p«r.oti. 

S<Di«i  Tttr  Tlr"  »ollov-Bp 

o  .)  0.  ,»..ti..  n  »  w  10.  •  """"" 
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a  distinction  between  getting  fired  and  other  reasons  for 
leaving  a  job. 

b)  On  question  37  on  page  22,  the  distinction  between  course  credits 
and  aemesCer  or  quarter  credits  is  unclear. 


In  General 


a)  An  attempt  should  be  made  to  develop  a  broader  range  of 
outcome  CetCa.    The  currents  testa  represent  a  narrow  range 
of  academic  skills. 

b)  Questions  should  be  added  pertaining  to  outside  supplementary 
instruction  while  in  high  school  (e.g.  SAT  tutoring,  music  lessons, 
use  of  SAT  prep  sottware,  vocational  training  etc.). 

Library  and  Media  Center  Survey 

a)  A  question  should  be  added  to  request  the  costs  for  the 
maintenance  of  computers  on  page  4. 

b)  Questions  should  be  added  to  determine  the  patterna  of 
current  use  and  future  needs  for  various  types  of  data  bases. 

III.  Other  Atencv  Data 

Preprimary  Enrollmenta  of  Children  3*5  ytars  old 

a)  This  is  a  good  tffort  to  develop  data  on  this  important  group. 
Additional  efforts  would  be  useful,  perhaps  dealing  with 
tducatiooal  optiooa  for  tveo  younger  children. 
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D^X<=k  I      INJEUI     MEEDS     F'OfR     PkM     ef=?A  OF" 
EDUC^T  I  OM  REF='OF:M 

By 

Allan  Oddcn 

Univsrsity  o-f  Southsrn  Cali-forni« 

In  this  paper  I  will  addr««e  my  comments  primarily  to  data 
n»8ds  4or  analyzing  and  assessing  -  4or  policy  purposes  -  the  Iwvel, 
allocation  and  use  o4  resources  for  elementary  and  secondary  schools. 
I  Mill  suggest  changes  4or  data  that  have  (or  have  not  been)  collected 
in  the  past  to  analyze  the  traditional  fiscal  issues  in  education  and 
school  finance,  and  will  suggest  a  number  of  new  types  of  d«ta  that 
are  needed  for  analyzing  issues  related  to  education  excellence 
concerns,  which  are  unlikely  to  whither  in  the  future. 

As  an  overview,  X  will  make  the  following  general  suggestions: 
1.    There  is  no  question  that  the  state  is  the  primary  actor 
in  education  policy,  finance  or  otherwise?  federal  data  collection 
should  reflect  this  fact.  Thus,  data  should  be  collected  on  m  district 
and  state  basisi  If  a  sample  of  district  data  are  collected,  which  is 
appropriate  for  many  data  sets,  the  sample  should  be  REPRESENTATIVE 
FOR  EACH  OF  THE  FIFTY  STATES,  as  well  as  for  the  nation  as  a  whole. 
Many  fiscal  data  in  the  past  have  been  used  for  state-by-state 
analyses  even  though  sampling  procedures  technically  did  not  produce  a 
valid  sample  for  each  state. 
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2.  School  -financ*  issues  now  should  bs  ♦rsmsd  ss  rssourcs  not 
just  fiscal  Allocation  issues,  since  the  relationship  between  cost  and 
quality  has  been  linked  finally  by  policy  pressure.  The  policy 
interest  is  in  improving  schools;  resources,  which  are  broader  than 
money,  become  means  to  tfose  ends.  The  education  excellence  or  reform 
movement  has  forced  the  merger  of  finance  analysis  with  education 
effectiveness  analysis,  if  not  totally  at  least  to  a  considerable 
degree.  Thus  revenue  ard  expenditure  data  should  be  augemented  by  data 
on  what  they  buy  such  as  human  resources  (teachers  and 
administrators),  curriculum  and  time. 

3.  The  policy  interest  In  improving  schools  and  the  link 
between  resource  analysis  and  education  effectiveness  also  raises  the 
need  for  data  on  the  allocation  and  use  of  resources:  money,  people, 
time  and  curriculum.  To  provide  the  analyses  needed  for  policy 
questions,  knowing  how  resources  are  used  becomes  as  critical 
information  as  knowing  the  level  of  resources  and  how  they  are 
distributed  across  districts.  Thus,  more  detailed  information  is 
needed  on  how  revenues  are  used,  including  at  least  expenditures  by 
program. 

In  short,  federal  data  collection  concerned  with  resources 
should  identify  the  state  (I)  as  the  unit  of  analysis,  should  broaden 


i.  Analysis  for  federal  policy  targets  the  stute  as  the  wnit  but 

uses  district  data  tool  analysis  for  state  policy  requires  district, 
school,  classroom  and  student  level  data. 
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the  definition  o*  resources  beyond  revenues  and  expenditures  to 
include  people,  time  and  curriculum,  and  should  provide  data  on 
resource  allocation  and  use  within  districts  as  well  as  resource 
distribution  across  districts. 

The  remainder  o*  this  paper  has  three  sections.  Section  one 
identifies  revenue  and  expenditure  data  that  should  be  collected  to 
conduct  traditional  school  finance  analyses  which  are  still  important, 
as  well  as  some  new  fiscal  analyses.  Section  two  outlines  date  needs 
for  human  resources  -  teachers,  administrators,  other  education 
personnel 1  and  students.  Section  three  identifies  data  needs  for  time 
and  curriculum. 

1  -      REVENUE     AND     EXF>END  I TURE     DA^T A 

NCES  should  continue  to  collect  state  aggregate  revenue  and 
expenditure  data,  and  revenue  and  expendit.ure  data  for  a 
representative  sample  of  districts,  where  the  sample  is  representative 
of  each  of  the  fifty  states  as  well  as  the  nation  as  a  whole.  Even 
federal  policy  is  now  increasingly  being  conceived  as  related  to  and 
sometimes  even  an  adjunct  to  state  education  policy I  this  means  that 
federal  data  efforts  need  to  have  accurate  data  for  each  state,  not 
iust  the  nation  as  a  whole.  This  probably  would  entail  a  shift  in  the 
sampling  frame  now  used  to  obtain  fiscal  data. 

For  EXPENOITURESf  there  should  be  a  strong  push  for  states  to 
collect  data  by  program,  so  that  NCES  data  can  provide  as  much  dat^  as 
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pcssibl*  on  how  r«v»nuM  *rm  u»ed.  Program  .xpenditure  data  become 
•v«n  mor.  important  in  thm  context  o4  »t«tB  education  policy  interest 
And  the  structuring  of  new  state  categorical  aid  program*.  Many  states 
have  created  new  education  re-form  categorical  programs  -  such  as 
Florida's  writing  program,  California's  tenth  grade  counseling 
program,  and  South  Carolina's  and  Texas'  preschool  programs  for 
at-risk  perschoolers.  Other  states,  like  Arkansas,  have  established 
new  educational  standards  or  raised  high  school  graduation 
requirements  and  expect  increased  general  revenue  dollars  to  be  spent 
to  implement  those  objectives.  Thus  there  is  strong  policy  interest  in 
how  dollars  are  spent  locally,  i.e.,  on  what  programs  dollars  are 
spent . 

Thus,  NCES  expenditure  data  should  include: 
o  EXPENDITURES  BY  FUNCTION  such  as  administration  (board  of 
education,  central  office  with  perhaps  a  breakout  for  curriculum 
units,  categorical  program  administration,  and  building 
administration),  instruction,  transportation,  operation  and 
maintenance  of  plant,  etc.    Within  the  instructional  category, 
expenditures  on  items  such  as  classroom  teachers,  special  program 
teachers,  pupil  support  services,  curriculum  development  and 
implementation,  textbooks,  materials  and  computer  hardware  and 
software  (new  categories)  are  needed.  There  still  is  a  need  to  know 
expenditures  by  the  traditional  functions!  indeed,  a  key  interest 
overtime  is  in  increasing  instruction  expenditure*. 

o  EXPENDITURES  BY  PR  -RAM  such  as  regular  education!  programs 
for  special  need  etudent*  such  as  the  handicapped,  low  achieving  (or 
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economically  di  ftadvantaged)  t   limited-English  proficient  and  gi^fted  and 
talented;  by  curriculum  content  area  or  at  least  broad  categories  of 
curriculum  such  as  mathematics^  science,  social  studies,  language 
arts,  etc.t  and  by  elamentary,  middle  and  secondary  level.  Given 
current  strong,  nationwide  interest  in  strengthening  the  high  school 
curriculum,  expenditures  by  broad  categories  of  curriculum  at  the 
secondary  level  have  a  priority.  While  these  data  may  need  to  tm 
developed  over  a  long  time  period,  the  fact  is  that  policy  interest  at 
both  the  state  and  federal  level  need  these  data  for  policy  analysis. 
My  hunch  is  that  state  policy  needs  will  provide  the  pressure  to 
produce  these  dataj  federal  interest  in  data  collection  of  this  sort, 
then,  could  give  additional  impstus  to  state  efforts. 

o  at  the  least,  expenditures  for  the  general  fund,  restricted 
fund  and  capital  fund  should  be  gathered. 

For  REVE^nJES,  NCES  needs  to  expand  the  detail  of  data 
collected  for  both  state  and  local  revenues.  Detailed  data  on  federal 
education  revenues  havs  dominated  the  revsnue  side  of  federal  data 
collection  in  the  pastf  that  detail  may  need  to  bs  retained  for 
federal  policy  purposes.  But  many  more  subcategories  of  state,  as  well 
as  local  revenue  nssd  to  be  coll acted.  Policy  needs  at  both  the  state 
and  federal  level  requirs  data  on  state  support  for  the  general 
program,  programs  for  special  need  student,  as  well  as  the  host  of 
rapidly  increasing  state  education  reform  categoricals.  The  fact  is 
that  states  are  expanding  the  numbsr  of  categorical  programs  through 
which  funds  are  distributed,  further  restricting  local  discretion  in 
resource  use,  but  also  stimulating  districts  to  expend  funds  in 


support  of  .ducation  r»*orm  obj«ctivM,  for  which  th»r»  i»  generally  a 
h.althy  overlap  b.twMh  most  atatM  and  th»  f»d»ral  government  at 

least  as  suggested  in  It!l.NitiBD_lt_Riik  report.  At  the  local  level, 
the  major  new  phenomenon  is  the  expansion  o*  non-property  tax  revenues 
which  range  from  local  education  foundations  to  school -business 
partnerships  and  local  option  sales  and  income  taxes.  These  revenue* 
sources  are  of  interest  at  the  state  and  federal  level. 
Thus,  NCES  REVENUE  data  should  include: 
o  some  smaller  sample  of  federal  revenues 
o  state  revenues  by  such  categories  as  general  aid, 
transportation,  and  facilities?  programs  for  special  need  students 
such  as  special  education,  compensatory  education,  bilingual 
education,  vocational  education  and  gifted  and  tal«nted|  and  education 
reform  categorlcalm  such  as  for  high  school  gr<  luation  requirements, 
content  areas  such  as  science  or  writing,  i^rit  schools,  tenth  grade 
counseling,  longer  days  and  y»ars,  prekindergarten  or  day  care  at 
schools,  full  day  kindergarten  and  mentor  teacher,  «aster  teach.r  or 

career  ladder  programs,  stc 

o  local  revenues  by  such  categories  as  local  property  taxes, 
local  sales  taxes,  local  income  taxesi  th»  traditional  fees  and 
community  services;  and  new  sources  such  as  local  educfc'wion 
foundations,  f ee-f or-service  activities  of  the  business  sort  such  as 
new  day  care  or  preschool  programs,  private  (either  pare,  c  or 
corporate)  contributions,  and  a  miscellaneous  category  which  in 
California  would  include  urban  development  grants  and  developers  fM». 
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In  addition,   local  property  wealth  data  (adjusted  by  di^r^ering 
local  assessment  practices),  average  district  household  income  and 
local  property,  income  or  sales  tax  rates  4or  schools  are  needed.  I 
know  such  data  are  di^^icult  to  collect  in  many  places.  But  gathering 
them  ior  states  ^or  which  they  are  available  would  be  a  good  4ir%t 
step. 

By  using  data  ^rom  other  governmental  agencies,  data  on  total 
state  and  local  taxesp  state  and  local  taxes  per  capita  and  per  tlOOO 
O'f  personal  income  and  any  indicators  o*  the  character  of  the 
incidence  o*  state  local  taxes  would  be  useful  in  NCES  compilations. 
NCES  compiles^  at  least  to  some  degree^  some  oi  these  data  from  the 
Census  Bureau^ s  periodically  collected  data  sets.. 

Finally,  •v«ryon«  us«s  th»  annual  and  TIMELY  NEA  ESTIMATES  OF 
SCHOOL  STATISTICS,  although  this  is  an  •xp«nsiv«  activity  to  undsrtak* 
(for  th«  NEA).  Th«  organizvtion  or  at  l«as.t  som«  p«opl«  in  it  ars  not 
convinced,  and  rightly  so  in  my  opinion,  that  data  collection  oi  this 
sort  is  worth  ths  costs.  Y«t,  th«s«  data  ar«  ussd  in  all  tiaisly  -  at 
Isast  for  policy  purposss  -  analysss  of  rssourcs  issuss  across  th» 
fifty  statss,  and  ai  •  a  critical  data  sst.  X  Nould  suggest  that  NCES 
collsct  thsss  data  or  giva  a  subcontract  to  NEA  to  continue  to  collsct 
thsss  data.  Ths  data  nssd  to  bm  produced  quickly  -  sstimatss  for  ths 
currsnt  acadsmic  ysar  nssd  to  bm  available  mid-way  through  ths 
acadsmic  year.  Thus,  if  NCES  wsrs  to  coll set  ths  data,  ths 
understanding  would  bs  that  publication  by  March  was  mandatory}  a 
subcontract  to  NEA  might  bs  an  sasisr  rout*  to  succeed  on  the  timely 
criterion.  And  for  these  data,  X  do  not  believe  the  NEA  label  makes 
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th,m  .uspectJ   th.  r.vi..d  NEA  ..tiT.te.  .nd  th.  much  lat.r  NCES 
figures  usually  dH^.r  ♦or  d.^nition.l  and  not  accuracy  reasons. 


2.      MUM^IM     RESOURCES  D^X^ 

Mor.  detailed  data  on  hu«»an  resources,  i.e.,  the  people  in  the 
education  system  -  student.,  teachers  and  administrators  -  are  needed 
not  only  because  policy  interest  is  Gorging  a  tighter  connection 
between  dollars  and  what  they  purchase,  but  also  because  interest  in 
the  human  resource  component  oi  education  is  high.  Indeed,  many  people 

that  the  key  to  success  oi  current  education  reform  is  the 
ability  o4  the  country  and  each  state  to  increase  the  number  o*  high 
quality  people  entering  and  remaining  in  the  teaching  profession.  A 
number  of  states,  groups       deans  from  the  top  colleges  o4  education 
snd  national  groups,  in  fact,  have  decided  that  strengthening  thu 
teaching  profession  is  th.  Key  to  bringing  about  a  restor.tion  of  the 
deteriorated  eKcellence  of  the  nation's  schools.  Finally,  .any  states 
sr.  r.structuring  the  teaching  profession  by  enacting  career  ladder, 
mentor  teacher  and  master  teacher  programs;  some  states  «ay  create  a 
ne«  category  of  teacher,  called  the  adjunct  teacher  -  a  professional 
in  some  field  «ho  teaches  part-time  but  does  not  hold  a  teaching 
credential.  Such  a  category  *,ould  open  the  education  system  to  high 
quality  people  without  reducing  standards  for  full  entry  into  the 
teaching  profession  for  people  -ho  want  to  teach  full-time.  In  short, 
as  the  structre  of  th.  teaching  profession  changes,  information  on 
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teachers,   including  typrs  o-f  teachers,  becomes  important.  Finally, 
sines  teacher  compensation  is  being  changed  to  conform  to  the  elements 

the  new  structures,  more  information  on  teacher  compensation  also 
is  needed. 

Thus,  NCES  teacher  and  administrator  data  should  include  the 
^ol lowing: 

o  numbers  (FTE)  of  classroom  teachers  by  teaching  area 
(elementary,  if^athematics,  science,  language  arts,  social  studies,  art, 
music,  etc.)  and  by  special  program  (compensatory  education, 
bilingual,  special  education,  gifted  and  talented) 

o  numbers  (FTE)  of  nonclassroom  professionl  personnel 1  such  as 
guidance  counselors,  psychologists,  etc. 

o  numbers  of  teachers  entering  and  leaving  the  above 
categories  each  ysar 

o  numbers  (FTE)  of  teachers  at  different  levels  in  a  career 
ladder,  numbers  of  master  teachers,  numbers  of  mentor  teachers,  or 
wnatever  categories  states  use  for  new  structures.  At  some  time,  the 
data  could  be  organized  into  a  limited  number  of  discrete,  generic 
categories  such  as  career  ladders,  master  or  mentor  teachers,  etc. 

o  numbers  (FTE)  of  teachers  working  10,  11  and  12  month 
contracts 

o  any  measure  of  quality  of  those  entering,  remaining  or 
leaving  -  score  on  a  national  teacher  exam  if  one  is  given,  perhaps 
the  NTE  until  that  time  period!  area  in  which  degree  earned 
(education,  a  discipline  such  as  mathematics,  science,  English, 
history,  etc) I  quality  of  college  attended  (using  some  list  that  ranks 
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colleces  and  universities  into  a  small  number  of  quality  levels);  SAT 
or  ACT  score;  or  whatever. 

D  nuft.t^rs  o*  adjunct  teachers^  teachers  with  ••emergency"  or 
"waiver''  credentials,  paraprof essionals  working  in  the  classroom,  etc. 

o  numbers  (FTE)  of  administrators  •  central  O'ffice  line  sta^ff, 
curriculum  coordinators  and  central  o-fficft  curriculum  staff,  staff 
development,  building  principals,  assi'^tant  principals,  assistant 
principals  for  instruction. 

The  idea  would  be  to  begin  identifying  new  categories  within 
which  to  group  teachers  or  in  which  statss  are  now  grouping  teachers, 
show  where  those  categories  are  being  used  and  how  many  new  teachers 
are  in  each  one.  The  data  might  be  fragmentary  for  awhile,  but  would 
show  the  evolving  nature  and  structure  of  the  teaching  profession. 
Fragmentary  data  are  acceptable  when  reported  on  a  state--by*-state 
basis.  The  need  for  data  on  the  evolving  structure  of  the  teaching 
profession  highlights  the  need  to  focus  on  the  state  level. 

NCES  data  for  teachsr  compensation  expenditures  would  include 
the  following: 

o  average,  median,  minimum  and  maximum  beginning  salary 
o  average  and  median  salary 

o  average,  median,  minimum  and  maximum  top  salary 

o  numbers  of  teachers  by  years  of  experience  as  well  as  by 

educational  attainment  -  M.A.,  Ed.D. ,  Ph.D. 

o  total  spent  for  base  salaries,  career  ladders  (total  for 

each  ladder),  mentor  teacher,  master  teacher  or  merit  teacher  programs 
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o  total  4or  benefits,  and  amount  for  for  each  benefit  - 
pension,  health,  dental,  life  insurance,  etc. 

o  similar  data  for  administrators  and  noncertified  personnel  1. 

Student  data  suggestions  are  given  here  in  the  human  resource 
section  of  the  paper.  Many  of  these  student  data  are  now  collected;  I 
list  them  only  to  emphasize  that  their  collection  should  continue. 
NCES  STUDENT  data  should  include: 

o  Total  PTE,  ADA  and  AOII  (although  an  PTE  figure  would 
suffice)  and  by  elementary,  middle  and  secondary  level 

o  Total  FTE  by  ethnic  background  (Anglo*  Black,  the  categories 
of  Hispanic,  Asian  American,  Native  American,  etc.)  and  in  special 
programs  -  compensatory  education,  bilingual  education,  special 
education,  gifted  and  talented. 

Enrollmnrnt  projections  for  the  nation  and  if  possible  for  each 
state  should  be  given  every  two  to  three  yearsf  most  people  were 
surprised  by  declining  enrollments  in  the  1970s.  If  the  lesson  then 
was  to  watch  trends,  the  lesson  soon  was  forgottsnl  most  have  been 
surprised  by  increasing  enrollments  in  thm  1980s.  Some  states  produce 
enrollment  projections!  others  do  not.  Highlighting  enrollment  trends 
nationally  at  least  would  keep  trends  in  the  numbers  and  types  of 
students  more  in  the  public  sys. 

For  all  these  human  resource  data,  X  am  probably  suggssting  an 
expansion  of  the  common  core  data  now  collected  each  fall I  the  new 
data  I  have  suggested  for  teachers  is  critical  since  significant 
changes  in  the  structure  of  the  profession  are  evolving,  turnover  of 
those  now  in  teaching  will  be  substantial  in  the  next  ten  years  due  to 


399 

389 


retirements,   .nd  newly  hired  teachers  will  b«  numerous  due  to  teacher 
retirements  and  rising  •nroUments  in  th«  n.xt  ten  years.  CoU.cting 
.d  analyzing  thes.  data  -ill  b.  crucial  *or  .ducation  policy  inter.zts 
at  least  ov«r  the  next  decade  and  •  hal*. 


3.      -TIME     PklMD     CURRICUL-UM  RESOUFcC 


Time  and  curriculum  are  the  other  t^o  categories  resources 
into  which  revenues  are  converted,  and  both  time  and  curriculum 
content  are  areas  o*  high  interest  *or  most  education  excellence 
reforms.  Thus,  some  aggregate  data  on  these  two  variables  are  needed, 
•ven  though  variations  in  time  and  curriculum  for  individual  students 
over  time  are  the  key  data  needed  for  analyzing  the  true  impacts  of 
these  variables.  Nevertheless,  the  macro-cor.te»ct  of  time  and 
curriculum  issues  also  is  important.   In  addition,  no  organization 
systematically  collects  the  type  of  data  mentioned  belo-  and  reports 

it  periodically. 

Thus,  NCES  TIME  data  should  include: 

o  length  of  school  year  and  day  for  teachers  and  for  students 
by  elementary  and  secondary  level,  preferrably  in  days  and  minutes. 

o  allocated  times  for  instruction,  by  some  categories  of 
content  areas  (mathematics,  language  arte  and  science  at  the 
elementary  level,  and  academic  area,  such  as  mathematics,  science, 
language  arts  and  social  studies  at  the  secondary  level) 
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NCES  CURRICULUM  d«t     hi    uld  includ*: 

o  high  school  grAdua^ar^  r»quir»m»nt»  adjusted  to  some  common 
norm  across  states 

o  numbers  oi  secondary  student  course  sections  (adjusted  to 
some  stindard  such  as  number  oi  sections  per  1000  students  and 
adjusted  for  enrollment  fluctuations)  by  academic  areas  (mathematics, 
science,  language  arts,  social  studies,  fine  arts,  performing  arts, 
etc.^  and  numbers  of  specific  courses  within  academic  areas  such  as 
algebra  I,  algebra  II,  geometry,  calculus,  general  mathematics,  etc. 
for  mathematics. 

In  sum,  future  NCES  collection  of  school  finance  data  should 
have  the  fell  owing  characteristics: 

o  focused  on  the  state  as  the  unit  of  analysis  -  sample 
district  data  should  produce  a  valid  sample  for  each  state 

o  broadened  to  include  resource  and  not  Just  fiscal  data  now 
that  policy  issues  have  linked  school  finance  with  school 
•f factiveness 

o  ad'Jitional  detail  on  state  and  local  revenue 

o  expanded  information  on  exp^enditures  such  as  expenditures  by 

program 

o  expanded  detail  on  teachers  -  numbers  by  type  (career, 
mentor,  master,  etc.),  quality  entering  and  remaining  in  the 

profession,  and  expenditures  for  base  salaries  as  well  as  increments 
for  career  ladders,  mentor  or  master  teacher  programs 

o  additional  information  on  time  and  curriculum. 
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Tilt  Elemtnttty/Steond.rj  Ilti««lgn  Ptojtct: 

A  ing  th.  condition  of  Eduction  In  th.  K.x.  t.cd. 

Penelope  L.  Peterson 
Unlvtrslty  of  Wl»con»ln-M«dl»on 

The  .t.t.4  putp...  of  th.  N.tl.n.1  Cnt.r  for  Eduction  S...l..lc« 
(NCES)  1.  to  coiuct  d.t.  0.  th.  conditio,  of  eduction  In  th.  Unlt.d 
set.,  .nd  to  publLh  r.p.rt.  .n.l,.ln,  .nd  Int.rpr.tln,  th...  d.t. 
(N.tlon.1  C.nt.r  for  Muc.lo.  St.tl..l«.  !»•«)•    »"        »  "«*"" 
of  th.  rol.  of  th.  NCES  1.  th..  th.  C.n..r  .hould  ooU.ct  d.t.  »d 
provld.  l.t.rpr.t.tlo..  of  th.  d.t.  th.t  .r.  .ufflcUnt  to  ,lv.  a 
"r..dln,"  of  th.  ,...r.l  h..lth  of  th.  ..tl..'.  .d.c..l...l  .y.t... 
J„.  ..  .  Ph,.lcl..  «...  .  f«  " 

of  th.  Wn  HCIS  .hould  foe.  th.lr  .ffort.  on  .  f»  ..l.ct.d 

«...  of  .d«ctlo.  ..th.r  tU.  .t.»Pt  to  coiuct  «t«.lv.  d.t.  on  . 
!„..  «^  of  «rl*l...   th»..  r.th.r  t««  .oU.c.l..  .-ltlo..l  <•«• 
on  ..n,  .«  v.rl.H...  I  prop...  th.t  «ES  coll.«  .«  »d  .ddltlon.1 
l.f.r«tlc  1.  thr..  «J.r  .r«.  r.l.»d  .o  .l«.t«T  ..c-*"^ 
.ductl...  .h...  th".  -jor  «...  -llht  h.  co.p.r.d  to 

..kl..  th.  p«l...  "»  ""•»"•  "* 

„fl„..  of  th.  .duc.lo«l  .T.t».    I.  th.  ..ctl...  th.t 

foil-.,  I  PtovW.  .  brl.f  dl.cu..l«.  .nd  r.tl...l.  for  th.  d.t. 
coiuctlo.  1.  ..ch  of  th...  «"  .re.  •«  .d""!-"- 

ThrM  ll..d.d  Ar."  of  I"  I"' 

TO  «....  th.  conditio,  of  *«vlc»  .d««l«»  1»  "« 
„  ...d  l.f.™.tlo.  th..  .ddr.....  thr..  -jor  ,u..tl...:  (I)  »h.t  ... 
.tud«>t.  dol..  ^  U-U.  1.  th.  ..tl..-.  .chool..  (2)  «b.t  .r.  th. 
c..c.m.  ..d  .tr.....  f.cl..  t..ch.r.  1.  th.  ...I..',  .chool.t  ~d  (3) 
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Hov  are  the  nation's  schools  responding  to  the  introduction  of  the 
microcomputer-**a  technological  innovation  that  may  or  may  not 
revolutionize  American  education? 

"Taking  the  Pulse"  of  Aperican  Education;    What  Are  Students  Doing  and 
Learning  in  the  Nation's  Classrooms? 

vnille  data  such  as  expenditures  for  public  schooling  provide 
Important  Infonnatlon  on  the  nation's  priorities  and  are  useful  to 
policy  makers  and  others  vho  must  allocate  resources,  they  do  not 
provide  an  adequate  measure  of  either  the  quality  or  success  of  our 
educational  system.    The  criterion  typically  used  to  judge  the 
effectiveness  of  our  schools  Is  students'  achievement  scores. 
Therefore,  the  achievement  data  collected  by  the  National  Assessment  of 
Educational  Progress  (NAEP)  are  extremely  important. 

NCES  and  NAEP  should  continue  to  collect  student  performance  data, 
and  they  should  give  increased  attention  to  the  need  to  l^rove  the 
measurement  of  higher-order  cognitive  skills  in  reading,  mathematics, 
and  science.    Although  NAEP's  measurement  of  hlgher*order  skills  xar 
exceeds  that  of  traditional  standardised  achievement  tests  such  as  the 
lova  Test  of  Basic  Skills,  their  measurement  of  higher-order  skill  is 
far  from  perfect.    Both  NCES  and  NAEP  should  give  high  priority  to 
refinement  and  further  development  of  test  itesM  that  measure  students' 
higher-level  cognitive  thinking  in  the  major  subject  areas. 

While  students*  achievement  scores  are  an  Important  measure  of  the 
condition  of  education,  students*  learning  actually  occurs  in  the 
nation's  classrooms.    To  take  the  pulse  of  American  education,  ve  need 
to  know  what  students  are  doing  and  learning  in  classrooms  in  the  United 
States.    The  best  metric  to  use  in  such  an  analysis  is  time. 
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Following  tht  publlcttlon  of  th»  Nitlon  >t  Risk  report  In  1983, 
■any  states  responded  to  the  recoBmendstlons  by  lengthening  the  school 
day;  toany  schocl  districts  set  minlnal  standards  for  the  nunber  of 
ninutes  that  teachers  Bust  spend  teaching  each  of  the  Mjor  subject 
areas  during  a  given  week.    The  impact  of  these  new  guidelines  on  what 
teachers  and  students  are  doing  In  classrooms  has  not  been  assessed. 
Moreover,  the  best  data  on  time  and  content  coverage  were  collected  by 
the  Beginning  Teacher  Evaluation  Study  in  the  mld-1970*a  (Fisher,  Fllby, 
Marliave,  Cahen,  Dishaw,  Moore,  &  Berliner,  1978;  Dechaa  &  Liebennan, 
1980),  and  these  data  have  not  been  updated  since  (Fisher  4  Berliner, 
1985).    Moreover,  the  original  BTES  data  were  collected  on  only  selected 
grades  (second  and  fifth  grade)  in  a  small  number  of  schools  in 
California. 

Information  is  needed  not  only  on  the  quantity  of  time  allocated 
and  spent  in  various  activities  in  classrooms  and  scboola,  but  also  on 
the  quality  of  the  activity.    For  example.  In  preparing  the  recent 
report  on  the  state  of  the  art  and  practice  In  teaching  reading  in  our 
schools,  the  Coaaisslon  on  Beading  vas  unable  to  find  Information  on  the 
time  that  teachers  arc  spending  in  phonics  Instruction  in  the  early 
grades  (Anderson,  Hlebert,  Scott,  h  Wilklnaon,  1985).    Information  was 
also  not  available  on  the  amount  of  time  that  students  arc  ipending  in 
silent  and  oral  reading  In  the  clemcmfary  and  middle  school  grades. 
According  to  the  Cosnission  Icport,  these  measures  might  serve  as 
indices  of  the  effectiveness  of  the  reading  instruction  that  la 
occurring  in  our  schools  and  would  be  highly  related  to  student 
achievement  in  reading. 

404 

Er|c  394 


Similarly,  although  some  researchers  have  documented  that 
elesentary  students  spend  more  than  50Z  of  their  time  during  reading  and 
mathematics  in  seatvork  activities  (Fisher  et  al.,  1978;  Peterson  & 
Fennems,  1985) •  little  descriptive  Information  exists  on  what  students 
are  working  on  during  seatvork.    In  particular,  ve  need  to  know  the 
amount  of  time  that  students  are  spending  in  *'busyvork*'  vhich  is 
unrelated  to  the  academic  subject  matter*  compared  to  the  proportion  of 
time  that  students  are  spending  on  specific  academic  content  whether  it 
be  content  that  consists  Isrgely  of  drill  and  practice  and  requires 
lower •level  cognitive  thinking  or  whether  it  requires  the  students  to 
engage  in  higher^level  thinking.    In  theit  recent  review  of  the  research 
on  school  effectiveness,  Good  and  Brophy  (in  press)  pointed  out  that 
similar  data  are  needed  for  homework  that  Is  assigned  to  students.  A 
Q  popular  widespread  belief  today  among  the  general  public  as  well  as 

aducators  is  that  studmnts  are  not  getting  enough  homework  and  need  to 
spend  more  time  on  homework.    However,-  no  data  exist  on  how  much 
homework  is  assigned  to  elementary  and  secondary  students  each  dsy»  how 
much  time  students  spend  on  homework,  and  the  content  of  the  homework 
that  is  assigned* 

The  above  are  examples  of  dsts  that  sre  needed  on  time  spent  by 
students  in  various  instructional  activities*    In  addition,  data  are 
needed  on  time  allocated  and  student  engsged  time.    (See,  for  example, 
Denham  &  Lieberman*  1980;  Fisher  ft  Berliner,  1985)*    The  results  of  the 
BTES  Study  showed  that  while  allocated  time  in  reading  and  mathematics 
was  significantly  positively  related  to  student  achievement  in  reading 
and  mathematics,  student  angaged  time  in  reading  and  mathematics  vss  s 

i 

better  predictor  of  achievement  than  allocated  time. 

^  395  405 

ERIC 


Hov  should  allocated  time,  tlae  spent,  and  student  engaged  tiice  be 
assessed?    Unfortunately,  these  data  cannot  be  gathered  by  «eans  of  a 
survey  or  questionnaire  adninistered  once  which  appears  to  be  the 
typical  data  collection  technique  u-ed  by  NCES.    Allocated  ti«e  has  been 
neasurcd  by  having  teachers  log  the  amount  of  tlae  that  they  schedule 
per  week  for  a  given  content  area.    It  is  important  that  the  content 
area  be  defined  Bore  specifically  than  slaply  reading,  Bathematics ,  or 
science  so  thst  the  InforMtion  will  be  useful  to  educstionsl  scholars 
and  practitioners.    Msrllsve,  Fisher,  &  Filby  (1977)  reported  thst 
allocated  tiae  data  froB  teacher  logs  "sgreed  st  sn  scceptsble  Itvel 
with  the  criterion  of  observstional  dsts"  (p.  57).    They  noted  further 
thst  the  dsts  were  Borc  relisble  if  they  were  recorded  iamedistely  sfter 
the  event.    Thus,  perhsps  teachers  should  not  be  ssked  to  record  the 
allocated  tlae  data  for  a  whole  Bonth  at  a  tl«e,  but  rather  for  a  week 
or  several  days  at  a  tlaa.    In  addition,  although  no  resesrchers  hsve 
investigated  how  Bsny  tlaes  during  the  yesr  one  Bust  collect  tescher 
lois  on  sllocsted  tiae  to  get  a  generslisable  estlaate,  one  presumes 
thst  this  Infoiaation  would  need  to  be  collected  several  tlaes 
throughout  the  yesr. 

Dsts  on  tlae  spent  and  student  engsged  tlae  Bust  be  collected 
through  sctusl  dsssrooa  observstions.    Although  svch  observstionsl  dsts 
•re  costly  to  collect,  they  Bight  provide  s  Bore  vslid  aessure  of  the 

I 

condition  of  educstlon  than  aucb  of  the  survey  dsta  that  has  been 
collected  by  HCES  In  the  past.   Moreover,  such  infoiaation  provides 
nor«ative  data  on  the  quantity  and  quality  of  Instructional  practices 
thst  are  occurring  in  various  subject  sress  In  our  eleaentary  snd 
sccondsry  schools  ss  well  ss  Inforaation  on  the  qusllty  and  quantity  of 
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the  content  that  students  ere  purported  co  be  learning.  Such 
infonratlon  would  be  useful  for  educational  practitioners,  policy 
oakers,  and  researchers.    In  addition,  researchers  on  effective  teaching 
have  found  allocated  tine,  time  spent,  and  student  engaged  tine  to  be 
significantly  related  to  student  achievement.    Thus,  these  data  may 
serve  ss  potential  indices  of  the  quality  of  instruction  that  Is 
occurring  In  American  classrooms. 

"Measuring  the  Blood  Pressure"  of  the  Nation's  Teachers;    What  are  the 
Stresses  and  Concerns  of  Teachers? 

An  upcoming  crisis  that  nay  significantly  affect  the  condition  of 
education  In  the  next  decade  Is  the  severe  shortage  of  qualified 
teachers.    Data  collected  by  NCES  show  that  by  1988  the  demand  for 
teachers  will  far  exceed  the  supply  (National  Center  for  Educational 
Statistics,  1984).    The  National  Science  Teachers  Association  estimates 
that  300,000  new  satbematlcs  and  science  teachers  will  be  needed  by 
199S~aore  than  the  total  number  of  mathematics  and  science  teachers 
currently  teaching  (Darllng-HaaDond,  1984).    Furthermore,  reports  have 
documented  that  the  most  talented  teachers  are  leavlag  the  profession. 
(See,  for  example,  Schlechty  i  Vance,  1983;  Darllne-Raamond ,  1984). 
These  two  factors  may  result  In  a  teaching  force  that  la  considerably 
less  qualified  and  competent  than  the  present  teaching  force,  which  may 
have  significant  negative  effects  on  the  condition  of  education  in  the 
next  decade.    For  example,  studies  of  schools  have  shown  that  staff 
stability  Is  an  important  measure  of  an  effective  school  (Mew  York  State 
Department  of  Education,  1974;  U.S.  Department  of  Health,  Education,  and 
Welfare.  1978). 
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At  tht  mlnlDuiD»  NCES  should  continue  to  colltct  the  kind  of  data  on 
supply  and  densnd  of  teachers  and  turnover  in  the  teaching  work  force 
that  it  has  collected  in  the  past.    In  addition,  MCES  should  continue  to 
collect  data  on  teachers*  salaries  because  salaries  In  the  teaching 
profession  have  bern  identified  as  one  of  the  salient  factors  related  to 
retention  of  qualified  teachers  (Darllng-Haamond»  1984;  Schlechty  & 
Vance,  1983). 

Beyond  these  data,  information  is  needed  oa  what  factors  may  be 
related  to  teachers  staying  In  or  leaving  t^4S  teaching  profession. 
Thus,  NCES  should  collect  data  on:    (1)  the  stresses  and  concerns  of 
teachers  in  our  nation's  elenentary  and  secondary  schools;  and  (2) 
information  on  the  professional  vorking  conditions  of  teachers  in 
elementary  and  secondary  schools. 

Fev  lmrge*scale  survey  studies  have  been  done  to  document  the 
concerns  of  teachers.    However,  most  recent  reports  on  schools  (e.g.. 
Boyer,  1983;  Sixer,  1984)  as  well  as  the  surveys  that  have  been  done 
(Darllng-Hanond,  1984)  suggest  that  teacher  dissatisfaction  and  stress 
may  be  most  related  to  professional  working  conditions.    In  addition  to 
collecting  large-scale  survey  data  on  teachers*  concerns  and  strtsses 
that  may  be  related  to  teacher  retention,  NCES  should  also  collect  data 
on  working  conditions  in  the  school. 

In  the  Milwaukee  School  District,  the  largest  urban  school  district 
in  the  state  of  Wisconsin,  the  two  Issues  that  are  of  greatest  concern 
currently  to  teachers  are:    (a)  class  size;  and  (b)  the  amount  of 
preparation  time  given  to  teachers.    As  a  consequence,  the  Milwaukee 
Teachers  Education  Association  is  introducing  legislation  in  the 
Wisconsin  State  Legislature  to  decrease  class  size  of  Milwaukee  teachers 
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and  to  increase  their  allotted  preparation  tine.    I.iadequate  preparation 
Clae  was  also  one  of  thrtt  factors  mentioned  by  the  teacher*  in  the 
Darllng-Hananond  (1984)  study  as  causing  the  greatest  teacher 
dissatisfaction. 

NCES  should  continue  to  collect  the  kind  of  data  that  It  has  been 
collecting  on  ttachtr/pupll  ratio  and  clasa  six*  (NCES.  1985).  NCES 
should  also  collect  data  on  the  amount  of  preparation  and  planning  tiiae 
given  to  ttachtr*.    Thla  Information  might  b*  colltcttd  through 
large-scale  surveys  of  school  districts  and  school  principals.  However, 
It  Is  Important  to  survty  ttachtrs  about  thalr  prtparatlon  and  planning 
time  to  chtck  for  validity  and  also  for  dlfftrtnces  In  perceptions  of 
what  constitutes  planning  and  preparation  time.    In  addition,  data  from 
taachcrs  on  how  they  epend  their  time  during  the  day  would  provide  some 
^  useful  ineighte  into  the  working  conditions  of  teachers.    Por  example. 

many  studies  have  euggested  that  teachers  are  dissatisfied  because  they 
sre  overwhelmed  with  administrative  duties  and  paperwork  that  detracts 
from  the  time  they  are  able  to  spend  in  actual  classroom  teaching, 
(e.g..  Boyer.  1983;  Darllng-Haamond .  1984). 

"Assesslnt  the  Reflexes"  of  the  American  Educational  System;    How  Are 
Schools  Responding  to  the  Microcomputer? 

The  recent  Influx  of  microcomputers  into  schools  has  stimulated 
widespread  discuseion  and  debate  at  all  levels  of  our  society.  Indeed, 
the  microcomputer  has  provided  a  focal  point  for  contending  educational 
philosophies  and  their  attendant  sets  of  priorities  for  allocation  of 
funds  and  time  within  schools  (Lepper.  1985).    Enthusiasts  believe  that 
microcomputers  will  radically  change  education  (Papert.  1980;  Kleiaan, 
198A).    Skeptics  believe  that  the  effects  of  the  microcomputer  are  at 
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best  exaggcrattd  *nd  tt  worst  will  h»ve  negstivt  consequences  for 
education  (Weiienbeun,  1976;  Sloen,  1984;  Brophy  &  Hannon,  1986). 

There  are  several  major  reasons  for  gathering  information  on 
microcomputer  usage  and  how  schools  arc  responding  tc  rhe  advent  of  the 
microcomputer.    First,  just  as  one  aspect  of  an  effective  organization 
is  its  ability  to  respond  to  change  (Chandler,  1962;  Miller,  1978),  one 
index  of  the  condition  and  quality  of  our  educational  system  may  be  the 
way  In  which  school*  are  responding  to  the  advent  of  an  innovation  such 
AS  the  microcomputer.    Second,  the  new  age  of  advancing  technology  ar.d 
global  competition  has  radically  changed  our  concept  of  "basic 
skills^—the  skills  necessary  for  a  person's  economic  competence. 
Students  will  need  to  have  basic  skills  in  the  use  of  microcomputers  in 
order  to  function  successfully  as  citizens  in  our  society.    In  addition, 
the  microcomputer  is  potentially  a  powerful  tool  for  ensuring  mastery  of 
other  basic  skills,  especially  in  the  areas  of  reading,  writing,  and 
mathematics. 

Third,  information  on  how  schools  arc  using  microcomputers  provides 
an  Index  of  how  our  educational  system  is  currently  responding  to  issues 
of  social  equity.    Although  children  from  higher  income  f sallies 
frequently  have  microcomputers  at  home,  children  from  lower  income  homes 
rarely  do.    Further,  achools  serving  more  affluent  comaunitles 
frequently  have  greater  parental  pressure  to  acquire  microcomputers, 
greater  resources  to  buy  them,  and  greater  human  resources  for  using 
them  widely.    If  children  from  low  Income  families  are  not  given  access 
to  the  new  technologies  In  schools,  they  may  fall  even  farther  behind 
their  affluent  peers  In  their  preparation  for  employment  in  a  era  of 
high  rechnolegy.    The  same  issues  arise  with  respect  to  gender. 
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Considerable  evidence  exists  that  boys  are  such  more  likely  than  girls 
to  becore  Involved  with  mlcrococputcrs  (Rlslcr,  Sproull,  &  Eccles» 
1983)*  especially  at  the  more  advanced  levels  (Hess  4  Miura,  In  press;. 
Micrococputers  are  still  a  relatively  scarce  resource,  especially  in 
elenentary  schools.    The  educational  community*  policy  makers*  and  the 
general  public  need  to  knov  hov  schools  #re  responding  to  the  challenge 
and  opportunity  to  make  effective  and  equitable  use  of  this  scarce 
resource. 

Thus  far*  the  only  extensive  national  data  collected  on 
microcomputer  usage  in  the  schools  is  from  a  national  survey  conducted 
by  (Becker*  1983a*  1983b*  1983c*  198A).    These  data  were  Included  in  the 
198A  Statistical  Report  of  NCES.    Vhile  survey  data  are  useful  on  the 
number  of  computers  owned  by  a  school  and  the  average  amount  of  time  per 


both  to  check  the  reliability  of  the  survey  data  and  also  to  provide  a 
more  complete  picture  of  hov  microcomputtrs  are  actually  being  used  in 
the  schools.    To  address  the  issut  of  social  equity*  all  data  on 
microcomputer  usage  should  bt  broken  dovn  by  sax*  race*  and 
socioeconomic  status  (SES)  of  student. 

The  data  collectad  on  microcomputer  usage  in  the  schools  should  be 
similar  to  the  kind  of  data  described  above  on  vhat  students  are  doing 
and  learning  in  the  classroom.    Such  data  might  Include:    (1)  allocated 
time  on  the  microcomputer  brok^tn  dovn  by  grade*  sex*  race*  and  SES  of 
student;  (b)  actual  time  spent  per  week  per  student  broken  dovn  by  the 
same  categories  of  student;  hu^.  (c)  student  engaged  time  on  the 
microcomputer  per  veek.    Allocated  time  data  should  be  collected  through 
teacher  logs  and  logs  of  teachers  vho  have  rtsponslblllty  for  the 


veek  that  students  spend  on  the  computer^  observational  data  are  needed 
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microconputer  rtsourct  roon.    Allocated  tla«  and  actual  time  spent 
should  be  eltarly  differentiated.    For  extaple,  it  is  not  clear  whether 
m  responding  to  Becktr's  national  survey,  schools  were  reporting  weekly 
use  data  on  microcomputtrs  that  rtflactad  allocated  tin*  or  actual  tiae 
•pent  on  the  aicrocoBputar.    This  quaation  Bight  be  addreased  by 
collecting  observational  data  which  could  be  usc'f  to  check  the 
reliability  and  validity  of  :he  survey  data  on  time  usage. 

Data  on  tlae  apcnt  by  each  atudent  on  the  aicroconputcr  and  atudent 
engaged  time  on  the  ■icrecoaputcr  ahould  be  collected  through  classrooo 
obaervationa  and  through  obaervationa  in  the  microconputer  resource 
rooo.    Obacrvcrs  ahould  record  the  kind  and  content  of  the  activity  in 
which  students  are  engaged  while  working  on  the  nicrocoaputer. 
Information  ia  needed  on:    (a)  bow  much  tine  atudenta  are  spending  on 
actual  academic  actiyitiea  compared  to  game-lika  activitiea;  (b)  whether 
the  activity  teacbea  computer  literacy  or  a  aubjact  matter  auch  ae 
reading,  mathamatica.  or  writing:  «»*  (c)  whether  the  microconputer 
activity  ia  a  bigher-lavcl  cognitive  activity  auch  aa  problem  aolving  or 
a  lowar-lavel  cognitiva  activity  auch  aa  drill  and  practica. 
Suanary 

la  aua.  we  have  argued  that,  in  t4a  nazt  decade.  MCES  ahould 
collect  data  in  thraa  aajor  new  araaa:    (1)  the  quantity  and  quality  of 
time  that  ia  allocated  to  ▼arioua  activitiaa  in  the  daaaroom,  and  the 
amount  of  time  atudenta  are  actually  apanding  and  engaged  in  auch 
activitiaa;  (2)  tba  concema  of  teachera  in  our  nation'.a  achoola  and 
information  on  working  conditiona,  including  the  amount  of  time  that 
teachera  are  apanding  in  ♦arioua  activitiea  during  the  day;  and  (3) 
microcomputer  naaga  in  the  achoola.  including  allocated  time,  time 
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spent,  and  student  tngagtd  tlmt  In  activities  broken  down  by  content  of 
activity  and  the  sex,  race,  and  socioeconomic  status  of  the  user. 

Finally,  in  the  next  decade,  NCES  might  improve  the  relevance, 
technical  quality,  and  utility  of  their  data  as  well  ae  improve  the  cost 
effectiveness  of  their  data  collection  efforts  by  collaborating  vith 
other  large  organizatione,  both  in  planning  data  collection  and  in 
gathering  the  data.    One  productive  avenue  for  collaboration  would  be 
for  NCES  to  work  closely  with  several  of  the  Educational  Research  and 
Development  Centers  that  will  soon  be  funded  by  the  National  Inatitute 
of  Education  (KIE).    HIE  has  requested  that  each  of  these  Centers 
reserve  101  of  their  budgets  in  1987  through  1990  for  collaboration  with 
other  national  Centers  (National  Inatitute  of  Education,  198A). 

if  NCES  were  to  focus  its  new  data  collection  efforts  on  the  Issues 
cmphaalzed  in  this  paper,  then  HCES  should  explore  collaborative 
relationahips  with  the  following  Centers:    (1)  NIE  Center  on  Teacher 
Quality  and  Effectivenesa;  (2)  HIE  Center  on  Student  Testing. 
Evaluation,  and  Standards;  (3)  MIE  Center  on  F'fective  Elementary 
Schoola;  and  (4)  NIE  Center  on  Effective  Secondary  Schoola.    The  NIE 
Center  on  Teacher  Quality  and  Ef factiveneaa  ia  auppoaed  to  gather  data 
from  the  teachers'  perspective  on  working  conditions  and  factora  that 
affect  teachers'  decisions  to  stay  In  the  profession.    NCES  might 
collaborate  with  the  SIE  Center  on  Student  Testing.  Evaluation,  and 
Standarda  in  the  development  and  refinement  of  tests  that  meaaure 
bigher-levd  cognitive  skills  In  reading,  ■athematica.  and  science. 
Finally,  NCES  might  work  with  the  NIE  Centera  on  Effective  Elementary 
Schoola  and  Effective  Secondary  Schools  to  collect  time  data  and 
observational  data  on  what  students  are  actually  doing  and  learning  in 
elementary  and  secondary  dassrooma  including  data  on  usage  of 
microcomputers . 
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ASSESSING  NATIONAL  DATA  ON  LDUCATION 


I 


Gauging  the  condition  of  education  in  the  United  States  necessarily 
involves  some  assessment  of  how  well  the  gauges  work.   Are  our  information 
systems  measuring  key  indicators?    Do  they  provide  accurate  readings?  Are 
they  optimally  linked?    In  this  assessment,  we  apply  these  questions  of 
coverage,  quality,  and  linkages  to  the  current  collection  of  national  statistics 
on  education  at  the  preprimary,  elementary/secondary,  and  higher  education 
levels.    At  each  level,  we  discuss  fundamental  policy  issues,  summarize 
major  data  bases,  and  evaluate  the  potential  of  existing  data  to  inform 
policy  discussions.    In  the  final  section,  we  recommend  ways  to  improve  the 
collection  of  national  statistics  on  education. 


DATA  ON  PREPRIMARY  EDUCATION 

Concern  about  preprimary  education  in  the  United  States  has  been  stimulated 
by  rising  participation  rates  and  a  recent  upturn  in  the  population  of  preschool 
age.    Heightening  the  concern  is  conflicting  evidence  over  the  importance  of 
such  education  for  later  achievement.    Results  from  the  Perry  Preschool 
Project  (Be rru eta-Clement  et  al.,  1984)  and  earlier  collaborative  work  (Lazar 
et  al     1974)  indicate  that  preschool  experience  has  sustained  benefits  for 
disadvantaged  children.    These  results  have  been  used  to  justify  expansion  of 
publicly  supported  preschool  education.   Critics,  however,  have  argued  that 
these  findings  are  not  applicable  to  most  preschool  programs. 

The  heightened  Interest  In  preschool  education  and  disagreement  over  its 
effectiveness  have  generated  a  need  for  information  on  what  education  Is 
currently  bping  provided  to  preschoolers,  what  outcomes  should  be  expected, 
and  how  preprimary  programs  complement  learning  In  the  home.    A  number  of 
questions  have  been  raised: 

0  Availability.   What  types  of  preschool  programs  are  available? 
What  types  of  children  participate  In  various  programs?  To  what 
extent  Is  preschool  education  available  to  low-income  families? 
How  are  programs  supported?   What  is  the  mix  of  public  and  private 
funds?    Is  the  current  pool  of  preprimary  programs  adequate  to 
meet  the  demand?   Can  it  meet  future  demand? 

0  Standards.    Under  what  standards  do  preprimary  programs  operate? 
Do  standards  differ  by  community,  family  background  of  participants, 
and  sponsorship?   What  standards  distinguish  high-quality  programs? 

•     0  Family-school  interaction.   How  do  preprimary  programs  complement 
learning  in  the  home?    How  do  families,  in  turn,  reinforce  preschool 
learning? 
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Only  a  haU-dozen  surveys  collect  nationally  representative  data  relevant 
to  these  policy  concerns.    Table  1  shows  the  six  data  bases  and  the  .categories 
of  information  they  cover.    Responsibility  for  government-sponsored  surveys 
is  divided  among  various  federal  agencies.    The  Education  Department  surveys 
that  gather  some  preschool  information  include  the  Common  Core  of  Data  (CCD) 
or.  public  school  systems  and  the  Hign  School  and  Beyond  (HSB)  longitudinal 
study  of  the  National  Center  for  Education  Statistics,  and  the  National 
Assessment  of  Educational  Progress  (NAEP)  of  the  National  Institute  of  Education. 
CCD  provides  statistics  on  kindergarten  and  prekindergarten  enrollment  in 
regular  public  school  systems  and  full-time-equivalent  teachers  at  this 
level.   HSB  and  NAEP  ask  students  to  report  retrospectively  on  whether  they 
had  been  enrolled  in  preprimary  programs. 

The  Bureau  of  the  Census  collects  data  annually  on  preprimary  enrollment 
and  occasionally  on  child-care  arrangements  of  working  mothers  through  the 
Current  Population  Survey  (CPS).    The  Department  of  Health  and  Human  Services 
(HHS)  data  collection  on  preprimary  education  is  now  limited  to  an  annual 
Head  Start  survey,  but  in  1976-77  HHS  also  undertook  a  comprehensive  study  of 
•day-care  centers.    Although  the  1976-77  National  Day  Care  Study  was  a  one-time 
study,  it  may  suggest  a  model  for  future  data  collections  and  is  included 
among  the  data  discussed  here. 

Data  Coverage 

Without  knowledge  of  the  current  availability  of  preprimary  education 
providers,  it  is  difficult  to  assess  how  well  enrollment  demand  is  being 
accommodated  now  and  Is  likely  to  be  accommodated. in  the  future.    To  answer  these 
questions,  policymakers  need  information  on  enrollments  in  various  types  of 
preschool  programs,  costs  of  services,  and  access  of  different  population 
groups  to  preschool  programs. 

National  data  are  available  on  participation  in  public  and  private 

nursery  schools  and  kindergartens  from  the  CPS.   Despite  the  growing  interest 

in  private  sector  involvement  in  providing  educational  services,  however, 

there  is  no  information  on  the  type  of  provider  (whether  nonprofit  or  profitmaking) 

and  on  sponsorship  ^whether  church,  employer,  or  comrojnity-sponsored). 

The  availability  of  services  to  different  population  groups  may  hinge  on 
costs  and  the  ability  to  pay  for  such  programs  but  data  are  sparse  on  costs 
for  preprimary  programs.    The  National  Day  Care  Study  collected  fairly  extensive 
data  on  expenditures,  revenue  sources,  fees,  donated  resources,  and  staff 
salaries,  but  these  data  applies  to  only  one  type  of  preprimary  program, 
licensed  day  care,  and  the  data  are  a  decade  old.    In  response  to  special 
requests  from  the  Education  Department,  the  CPS  asked  for  information  on 
tuition  paid  for  private  nursery  schools  and  kindergartens  in  1979  and  1982. 
But  tuition  data  are  not  routinely  collected  in  the  CPS  and  can  be  tied  to 
only  a  few  program  characteristics.    The  Head  Start  program  annually  estimates 
its  average  cost  per  child,  but  expenditures  for  Head  Start  cannot  be  generalized 
to  other  preschool  arrangements.    Moreover,  the  Head  Start  program  serves 
only  one  in  four  of  the  eligible  low-income  children  and  provides  no  data  on 
the  total  need  for  preschool  care  among  low-income  populations  or  on  cost 
barriers  to  providing  such  care. 
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TABLE  T:    VARIABLE  CATEGORIES  COVERED  BY  SELECTED  PREPRIMARY  EDUCATION 
DATA  BASES 


Data  bases 


Processes- 
curriculum, 

Outcomes     climate.  Resources  Student 

'  standards   background 


Education  Department 
Common  Core  of  Data  (CCD) 
High  School  and  Beyond  (HSB) 


National  Assessment  of 
Educational  Progress  (NAEP) 


CI 


Other  Federal  Agencies 

Current  Population  Survey  (CPS) 

Head  Start  annual  survey 

National  Day  Care  Study 
(1976-77) 


□ 


IN. 

IZI 


□ 


IZI 

□ 


[21     -  Complete  data 
fSy    »  Incomplete  data 
=  No  data 
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Questions  of  standards  for  preprimary  education— and  yovernment  invo'ivement 
in  setting  standards--are  being  discussed  in  state  legislatures  across  the 
nation.    Informed  debate  requires  knowledge  of  what  constitutes  adequate 
standards  and  how  well  existing  services  match  these  standards.  Moreover, 
in  defining  an  adequate  level  of  service,  it  is  important  to  know  the 
extent  to  which  preschool  experience  affects  a  child's  short-  and  long-term 
progress  in  school.   Questions  to  be  addressed  in  establishing  standards 
include  these:    What  credentials  should  staff  have?   What  represents  an 
acceptable  staff-to-child  ratio?    How  much  time  should  young  children  devote 
to  structured  learning  activities? 

Information  on  the  quality  of  current  programs  is  virtually  nonexistent, 
lacking  the  most  basic  data  on  preschool  processes  and  outcomes.   The  evidence 
from  effective  preschool  programs  points  to  the  importance  of  the  quality 
issue.   The  Perry  Preschool  Project,  which  yielded  long-term  benefits  for 
young  children  from  disadvantaged  homes,  stressed  the  "high  quality"  of  the 
program,  as  measured  by  high  staff-to-pupil  ratios,  extensive  home  visits, 
and  a  fully  articulated  curriculum. 

The  last  national  attempt  to  gather  comprehensive  information  on  preschool 
processes  was  the  National  Day  Care  Study  in  1976-77.    This  study  identified 
variables  that  appeared  to  improve  children's  gains  in  test  scores,  such  as 
the  specific  child-related  education  of  thp  caregiver,  a  finding  that  has 
implications  for  teacher  certification. 

The  Head  Start  program's  ongoing  annual  survey  asks  for  information 
on  staff  credentials  in  early  childhood  education,  but  does  not  ask  for  any 
child  performance  measures  beyond  the  number  of  children  who  drop  out  of 
the  program,  thereby  missing  an  opportunity  to  link  standards  with  outcomes. 

Data  from  HSB  and  NAEP  also  could  potentially  tie  participation  in 
preschool  with  later  performance,  but  retrospective  reporting  and  the  fact 
that  nothing  is  known  about  the  characteristics  or  quality  of  these  programs 
limit  the  utility  of  these  data. 

"If  studies  of  school  achievement  have  shown  one  thing,  it  is  the  importan'::e 
of  the  family,"  concludes  Coleman  in  his  latest  study  of  schools  (1982,  p.  19). 
To  assess  the  preschool  experience,  it  is  critical  to  discover  the  complementary 
nature  of  preschool -home  relationships.    For  example,  how  much  time  do  parents 
spend  participating  In  learning  activities  with  their  children?  What  home 
learning  activities  are  most  beneficial?  What  are  the  net  effects  of  preschool 
education  in  relation  to  the  home  environment? 

Only  one  national  data  base  provides  any  reasonable  information  on  home 
activities  for  children.    The  University  of  Michigan  Time-Use  Study  gathered 
information  in  1975  and  1981  on  parent-child  interaction  through  home  diaries, 
but  this  study  Included  too  few  young  children  to  focus  on  the  preschool 
years  and  did  not  collect  performance  data  for  this  age  group. 
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Indeed,  no  national  surveys  have  looked  at  the  home  environment  and  the 
preschool  environment  together  to  suggest  how  learning  may  be  reinforced  or 
confounded  by  different  settings.    Some  researchers  have  posited  that  the 
"hidden  curriculum"  provided  in  middle-class  homes  exerts  so  strong  an  influence 
on  learning  that  Instruction  offered  in  a  formal  preprimary  setting  yields  no 
net  learning  benefits  for  middle-class  youngsters.    Current  national  data 
bases  provide  no  information  with  which  to  address  this  subject. 

Data  Quality 

Data  availability  is  obviously  the  largest  problem  at  the  preprimary  level, 
but  accuracy  is  also  a  concern.    When  the  various  data  bases  do  overlap, 
they  may  not  agree.    For  example,  public  preprimary  enrollment  reported  through 
CCD  shows  some  half-million  children  fewer  than  the  3.5  million  estimated 
from  the  CPS  household  survey.' 

An  examination  of  the  CCD  suggests  that  some  local  school  districts  and 

state  education  agencies  have  difficulty  reporting  accurate  preprimary  enrollment 

andstaffing  information,  particularly  in  distinguishing  between  headcount 

and  full-time-equivalent  enrollments.    Yet  household  respondents  in  the  CPS 

may  be  equally  inaccurate  in  reporting  preprimary  enrollment.  Although 

the  CPS  distinguishes  between  home  day  care  and  formal  preprimary  programs, 

it  leaves  the  classification  of  center-based  day  care  to  the  household  respondent. 

Thus,  the  rather  thorny  problem  of  defining  center  care  as  instructional  or 

custodial  is  left  to  the  respondent  and  presumably  this  definition  could  vary 

from  one  respondent  to  the  next.  i 

Data  Linkages 

A  major  hindrance  to  progress  in  developing  data  on  preprimary  education 
is  the  fact  that  no  single  agency  has  a  clear  mandate  to  collect  the  information. 
The  Department  of  Education  is  just  beginning  to  formulate  proposals  to 
address  the  area  of  early  childhood  education.   The  largest  federal  education 
program  at  the  preprimary  level.  Head  Start,  is  administered  outside  the 
Department  of  Education  by  HHS.    In  recent  years,  HHS  has  all  but  closed  down 
its  statistical  collection  activity  in  preprimary  education,  except  for 
annual  reporting  on  Head  Start.    The  comprehensive  but  costly  ($7  million) 
National  Day  Care  Study  in  the  late  1970s  required  a  commitment  of  resources 
that  are  no  longer  available.   With  no  agency  yet  assuming  the  lead  in  this 
area,  data  collection  efforts  have  been  sporadic,  piecemeal,  and  uncoordinated. 


DATA  ON  ELEMENTARY  AND  SECONDARY  EDUCATION 

Concerns  with  improving  education  dominate  issues  in  elementary  and 
secondary  education.   Various  reports  have  called  attention  to  performance 
declines  over  the  recent  past  and  the  need  to  upgrade  American  education, 
spurring  many  states  to  pa£S  costly  reforms.   Policymakers,  educators,  and 
the  public  need  to  be  able  to  assess  whether  these  reforms  are  working  and 
whether  they  are  getting  their  money's  worth.    In  addition,  the  drive  toward 
excellence  has  heightened  the  concern  about  providing'equal  opportunity  to 
all  students.    It  is  generally  recognized  that  if  the  Nation's  schools  are  to 
improve,  everyone  should  be  encouraged  to  share  in  this  improvement.  Current 
policy  debates  revolve  around  these  questions: 
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0  Educational  improvemert ,    Are  educat  ^eforms  actually  improving 

student  outcomes'? 


0  Resource  effectiveness.    Are  resources  being  applied  to  promote 
cost-effective  educational  programs? 

0  Equity,    Are  the  needs  of  disadvantaged  and  other  special  population 
groups  being  met? 

Although  a  number  of  national  data  bases  describe  different  aspects  of 
elementary  and  secondary  education,  three  that  have  already  been  mentioned 
stand  out  as  the  major  ongoing  sources  of  national  information,  as  shown  in 
Table  2.    The  CCD  survey  of  all  state  educational  agencies  and  local  school 
districts,  is  the  primary  source  of  information  on  schooling  inputs— enrollment, 
finances,  and  staffing.    NAEP  focuses  on  measuring  educational  outcomes.  The 
HSB  longitudinal  survey  is  the  only  one  with  extensive  information  on  family 
background,  school  process  variables,  and  student  outcomes.  Specialized 
information  on  elementary  and  secondary  education  is  available  from  various 
ether  NCES  surveys:  the  Private  School  Survey;  the  Survey  of  Teacher  Demand 
and  Shortages;  and  the  Library /Media  Center  Survey. 

With  respect  to  particular  populations  of  special  concern  to  the  federal 
government,  the  Office  for  Civil  Rights  surveys  districts  and  schools  for 
information  on  programs,  disciplinary  actions,  and  graduating  class  composition. 
Individual  federal  education  programs,  such  as  those  serving  the  handicapped 
or  the  limited-English  proficient,  conduct  their  own  surveys  of  participants 
(  and  coverage. 

Other  federal  agencies  and  private  organizations  also  provide  elementary 
and  secondary  edu  ation  data.    The  CPS,  mentioned  earlier,  supplies  annual 
data  on  enrollmenc,  public  and  private,  and  educational  attainment.  The 
Justice  Department  collects  information  on  school  discipline.    HHS  funds  - 
"Monitoring  the  Future,"  an  annual  survey  of  high  school  seniors  which  focuses 
on  student  attitudes  and  drug  abuse.    The  National  Science  Foundation  (NSF) 
conducts  studies  on  math  and  science  education.    The  Labor  Department's 
National  Longitudinal  Survey--Youth  Cohort  (NLS— -Youth)  contains  extensive 
information  on  family,  schooling,  and  work  history.   A  private  consortium, 
the  International  Association  for  the  Evaluation  of  Educational  Achievement 
(lEA),  periodically  assesses  comparative  student  performance  In  various 
nations.   The  National  Education  Association  (NEA)  collects  information  from 
its  state  coordinators  on  enrollment,  staff,  and  salaries. 

Data  Coverags 

As  a  result  of  the  clear  demand  for  school  improvement  and  the  expenditure 
of  billions  of  dollars  on  educational  reforms,  information  is  critically 
needed  on  whether  t*^,.o  reforms  are  improving  outcomes  and  which  reforms  seem 
most  effective.    Ultirhately ,  data  should  Indicate  whether  student  performance, 
as  measured  by  educational  achievement  and  attainment,  has  improved  and  for 
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TABLE  2:    VARIABLE  CATEGORIES  COVERED  BY  SELECTED  CLEMENTARY  ANU  SECONDARY 
EDUCATION  DATA  BASES 


Data  bases 


Outcomes 


Processes-- 
curriculum, 
cl  imate, 
standards 


Fducation  Department 

Common  Core  of  Data  (CCD) 

National  Assesment  of  Educational  Progress 
(NAEP) 

High  School  and  Beyond  (HSB) 

Private  School  Survey 

Teacher  Supply  and  Demand  Survey 

Library /Media  Cente'^  Survey 

Civil  rights  survey 

Special  education  program  surveys 

Language  minority  surveys 

Other  Federal  Agencies 

Current  Population  Survey  (CPS) 

Justice  Department  surveys 

National  Science  Foundation  (NSF)  surveys 

'dtional  Longitudinal  Survey—Youth  Cohort 
(NLS— Youth)  (Labor  Department) 

Monitoring  the  Future—Drug  Abuse 
(Health  and  Human  Services) 

Private  Organizations 

International  Association  for  Evaluation 
of  Educational  Achievement  (lEA) 

National  Education  Association  (NEA) 
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whom.    This  information  should  be  available  nationally,  but  also  disaggregated 
at  least  down  to  the  state  level,  since  the  states  are  primarily  responsible 
for  education. 

Most  of  the  national  data  bases  listed  in  Table  2  provide  little  help  in 
answering  these  questions.    Few  provide  performance  information.    The  extensive 
ddta  collected  on  resources  can  report  little  about  the  quality  of  inputs, 
such  as  the  quality  of  teachers,    A  few  data  bases  contain  some  information 
on  schooling  processes,  but  the  data  often  apply  to  highly  specific  areas  such 
as  the  provision  of  special  education  for  the  handicapped. 

HSB  presents  reasonably  good  information  on  school  outcomes  and  processes, 
but  its  performance  test  is  limited  to  only  a  few  items.    The  information 
pertains  only  to  high  school  processes  and  tells  us  little  about  experiences 
before  high  school.    The  national  data  are  of  little  help  to  particular 
states  working  to  evaluate  their  systems. 

NAEP  offers  some  advantages  over  HSB  in  assessing  reforms.  NAEP's 
tests  are  much  more  extensive  than  HSB's  and  are  not  limited  to  high  school 
students.    NAEP  also  surveys  the  schools  more  often  than  HSB.  Furthermore, 
although  NAEP  initially  focused  on  outcome  data,  it  has  expanded  its  information 
on  classroom  processes  and  school  and  teacher  characteristics,  snd  it  contains 
some  home  background  information. 

But  NAEP  also  has  disadvantages.    First,  NAEP  is  subject  specific,  that 
is,  in  a  given  year,  NAEP  focuses  primarily  on  a  few  learning  areas  instead 
of  providing  a  comprehensive  picture  of  what  is  happening  within  the  whole 
school.-  Second,  NAEP  consists  of  repeated  cross  sections  and  cannot  be  as 
informative  as  HSB  with  respect  to  measuring  transitions  over  time,  such  as 
dropping  out  of  school.    Furthermore,  like  HSB,  NAEP  cannot  provide  state- 
or  district-level  comparisons.  The  current  NAEP  design  does  allow  states  to 
expand  the  sample  to  provide  representative  scores,  but  to  date  only  three 
states  have  done  so.    Thus,  although  states  carry  the  primary  responsibility 
for  education,  the  nation  has  no  way  of  accurately  assessing  how  well  state 
governments  are  carrying  out  these  responsibilities. 

Other  data  bases  provide  additional  information  on  reform,  but  all  are 
limited  in  important  respects.    lEA  compares  achievement  in  a  number  of  countries, 
but  the  data  are  highly  aggregated  and  the  long  intervals  separating  reports 
(sometimes  15  jears)  makes  lEA  unsuitable  as  a  gauge  of  reform  effects. 

On  the  question  of  resource  effectiveness,  research  findings  have  shown 
that  overall  expenditures  and  student  performance  are  only  weakly  associated. 
Hence,  to  examine  the  quality  of  resources  and  the  ways  they  translate  into 
school  processes,  statistics  must  be  collected  below  the  level  of  broad 
expenditure  components. 
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Th«  rrn  annuaUv  collects  revenue,  expenditure,  and  debt-financi ny  statistics 

In  soSe   6  000  schoo   districts.  'son,e  of  these  data  are  i"^P°^i^"J,(°J,f  ""^^'^  ^ 

effici^lncY  issues,  such  as  breakouts  of  administration  and  instructional 

fol  onents  if'ex  ;nditures.  but  many  of  the  items  ^-J^^^J-"  J"  .[^P^f^J^^'che^s- 
parh  vear     On  the  other  hand,  despite  the  concern  over  the  quality  or  teacne.  s 
Se  /ost  critical  resource.  CCD  no  longer  collects  information  on  what  eac. 
state  pays  its  teachers. 

Because  administrative  records  on  inputs  are  readi lyavai lable.  data  are 
often  collected  without  sufficient  regard  to  priorities.    Library  stat  sties 
for  example   are  able  to  provide  data  on  a  full  range  of  variables.  Although 
libranesa^e  essential  fSr  education,  something  is  wrong  when  NCES  can  report 
periodicals'  costs  but  not  teachers'  salaries. 

Measurina  how  well  groups  with  special  needs,  such  as  language  and  racial 
Sities    are  faring  as  a  result  of  reform  efforts  requires  performance 
rnfSmaJion  for  these  group     nd  some  understanding  of  the  relationship 
I  Irn'^dSclJ^on  in%?hoo?  and  conditions  outside  school     Data  on  specif 
DODulations  and  their  performance  are  available  from  program  data,  HSB,  and 
nXep   but  the  data  are  Inaccurate.    And  we  lack  the  information  to  understand 
ly  ch?  dren  with  special  needs  fall  so  far  behind  in  "^'^^  ;  ^"PJ^^^^^^J^^^^^^ 
of  orooress  in  the  earliest  grades.    If  we  are  to  measure  the  extent  to  which 
students  fall  behind  early,  we  need  detailed  information  on  the  school  and 
outside  environment  in  the  formative  pre-high-school  years,  data  that 
are  almost  nonexistent. 

Data  Quality  { 

Tha  aualitv  of  data  on  elementary  and  secondary  education  varies  greatly. 
Perf3?J«Jce  as  indicated  by  standardized  tests,  is  one  of  the  br.tter-measured 
vrriablts^   NAEP,  in  particular,  has  devoted  considerable  effort  to  improving 
outcome  m;asurr.^nts  Snd  ha.  introduced  a  new  scaling  system  that  may  permit 
comparisons  across  grades. 

Estimates  of  high  school  dropouts  are  less  satisfactory.    In  the  drive  to 
promote  educational  excellence,  the  high  school  d^-opof  J "ue  was  initial ^ 
swep;  aside.    This  appears  to  have  been  a  serious  mistake;  evidence  from 
several  sources  shows  that  the  problem  is  severe.   However,  the  reported 
hiah  school  dropout  rates  are  error  prone.    Estimates  from  alternate 
sources  d?;fer  5n  the  extent  of  the  problem  and,  in  the  absence  of  agreement 
on  a  baseline  number.  It  is  hard  to  gauge  whether  the  dropout  problem  is 
improving  or  getting  worse. 

A  dropout  rate  can  be  calculated  from  the  CCD  by  comparing  the  residual 
Sf  the  number  of  high  school  graduates  with  the  number  of  students  in  the 
9th  grade  4  years  previously;  this  approach  yields  a  dropout  rate  of  11 
percent.    In  contrast,  the  CPS,  which  uses  household  interviews  for 
information  on  educational  attainment,  reports  a  dropout  rate  of  only  lb 
percent.   The  CPS  does  not,  however,  report  how  schooling  was  completed, 
whether  through  graduation  from  a  regular  high  school  program  or  other 
means   such  as  earning  an  equivalency  certificate  or  externa   degree.  The 
Topoit  rate  can  also  be  calculated  from  the  HSB  longitudinal  study,  but 
this  rate  is  qeneraPy  acknowledged  to  represent  an  u.idercount  because  it 
misses  students  who  leave  school  before  the  end  of  their  sophomore  year. 
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School  process  variables  pose  similar  problems;  even  the  simplest  are 
sometimes  hard  to  measure.    HSB,  to  its  credit,  compared  student  self-reports 
of  courses  and  grades  with  coursework  transcripts  and  found  substantial 
misreporting.    Unfortunately,  quality  control  studies  have  not  been  carried 
out  for  other  types  of  process  data,  such  as  information  on  school  climate 
and  order.    Students'  responses  need  to  be  validated  against  reports  from 
teachers  and  a'dministrators  on  these  critical  variables. 

Da^a  on  the  use  of  resources  are  so  unreliable  that  assessing  efficiency 
in  American  schools  is  quite  problematic.    Large,  implausible  year-to-year 
variations  in  per  pupil  expenditures  appear  for  some  states.  Pupil-to-staff 
ratios  calculated  from  state  reports  also  are  unreliable;  for  example,  the 
highest  and  lowest  state  pupil-to-all-staff  ratios  differed  by  140% 
on  this  measure  in  1983.    Either  the  reported  numbers  are  faulty,  or  some 
states  have  remarkable  efficiency  advantages  over  others. 

On  the  question  of  whether  special  populations  are  being  well  served  by 
American  education,  the  data  are  also  suspect.    A  prerequisite  for  addressing 
this  issue  is  agreement  on  the  target  populations;  numbers  for  most  of 
the  federal  target  groups  are  at  best  questionable.    For  example: 

0  In  1984,  special  educational  students  as  a  proportion  of  State 
enrollment  ranged  from  a  Ic*-;  of  5%  to  a  high  of  13%  (U.S. 
Department  of  Education,  Office  of  Special  Education  and 
Rehabilitative  Services,  1985).   There  is  no  physiological  explanation 
that  could  account  for  these  report  differences  exceeding  100% 
in  the  prevalence  of  handicapping  conditions. 

0  The  Office  of  Bilingual  Education  and  Minority  Languages  Affairs 
estimates  that  about  3.6  million  language-minority  children  need 
bilingual  services,  'jut  a  recent  study  based  on  Census  Bureau 
data  concludes  that  two-thirds  of  the  children  Included  in  this 
number  use  English  as  their  usual  or  sole  language,  and  thus  could 
h£  dly  be  classified  as  candidates  for  instruction  in  a  language 
other  than  English. 

Finally,  there  1s  the  difficulty  of  obtaining  educationally  relevant 
information  on  households,  such  as  family  Income  and  parental  reinforcement  of 
education.   This  Information  appears  to  be  far  more  accurately  reported 
through  home  questionnaires  rather  than  from  student  responses.  HSB 
validity  studies  show  that  students  may  seriously  misjudge  family  background 
characteristics;  comparisons  between  students'  and  parents'  reports  of 
parental  occupation,  family  Income,  and  mother's  work,  for  example, 
yielded  validity  coefficients  of  only  about  .5  (U.S.  Department  of  Education, 
National  Center  for  Education  Statistics,  1984). 

Statistical  gathering  by  the  federal  government  often  involves  inordinate 
time  lapses  between  data  collection  and  dissemination.    Indeed,  private 
organizations  routinely  publish  similar  data  that  are  both  more  comprehensive 
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and  more  timely.    For  example,  the  CCD  provides  the  location  and  enrollments  of 
all  elementary  and  secondary  schools,  but  the  most  recent  school  year  for  which 
this  information  is  available  is  1982-83.    In  contrast,  private  firms  have^ 
compiled  similar  files  that  provide  much  greater  information  on  each  schoo. 
site  for  the  1984-85  school  year.    As  a  second  example,  the  NEA  reyularly 
publishes  stato-level  financial  and  staffing  data  for  the  preceding  and  current 
school  years.    These  data  are  generally  more  complete  than  those  the  Education 
Department  publishes  and  at  least  1  to  2  years  more  current. 

Data  Linkages 

The  collage  of  elementary  and  secondary  data  bases  provides  cogent 
examples  of  the  advantages  of  integrating  performance  data  with  other  kinds 
of  information.    Two  of  the  most  successful  information  activities  in  the 
elementary  and  secondary  school  area,  in  terms  of  use  and  attention  to 
findings,  are  HSB  and  the  Education  Department's  "wall  chart  which  graphically 
prof iles*state-'iy -state  comparisons  on  college  entrance  test  scores  and 
resource  variables.    By  contrast,  detailed  financial  statistics  reported  in 
isolation  in  the  CCD  or  extensive  library  statistics  tell  little  about 
school  quality  and,  hence,  are  not  widely  used. 

The  data  on  teachers  also  points  to  the  need  to  consider  data  collection 
as  a  cohesive  whole.    Five  separate  questionnaires  from  the  Department  of 
Education  have  recently  sought  information  from  the  states  about  teachers: 
CCD,  HSB,  NAEP,  Survey  of  Teacher  Demand  and  Shortage,  and  a  >-'jw  Public  School 
Survey.  *Yet  after  all  these  surveys,  the  Department  still  does  not  know  how 
much  each  state  pays  its  teachers. 


DATA  ON  HIGHER  EDUCATION 

Education  Secretary  William  J.  Bennett  has  called  for  a  rethinking  of 
higher  education— both  its  funding  and  its  functions.   Questions  have  been 
raised  concerning  access,  cost,  quality,  and  the  roie  of  higher  education 
in  the  United  States  today.   Because  student  aid  accounts  for  nearly  half 
of  all  the  Department  of  Education's  spending,  the  government  needs  to  know 
if  the  aid  is  being  properly  targeted  and  wisely  spent.  Institutional 
efficiency  is  also  being  questioned  in  relation  to  rapidly  rising  tuitions 
and  purported  decreases  in  faculty  teaching  loads.    Indications  of  declining 
performance  and  unbalanced  curriculums,  moreover,  call  into  question  the  very 
quality  of  higher  education.    The  trend  toward  greater  vocationalism  in 
college  studies,  along  with  increased  corporate  training,  stinwlates  concern 
that  higher  education  is  not  fulfilling  its  mission. 

Data  sources  presented  in  Table  3  are  considered  in  this  section  as  they 
pertain  to  these  issues: 
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0  student  aid.   Who  receives  federal  student  aid  and  how  can  aid 
be  refocused  to  provide  greater  access  to  the  most  disadvantaged 
students? 

0  Efficiency.    Why  have  tuition  charges  increased  faster  than 
the  inflation  rate,  and  how  can  escalating  costs  be  contained? 

0  Value,    What  is  the  quality  of  the  educational  experience  and  of 
college  graduates?   What  is  being  learned? 

0  Role,    What  is  the  role  of  higher  education,  particularly  in 
relation  to  occupational  and  corporate  training? 

Information  on  higher  education  is  obtained  by  a  diverse  group  of  governm^.nt 
and  private  organizations.   At  the  federal  level,  the  Higher  Education  General 
Information  Survey  (HEGIS)  of  NCES  collects  information  from  all  institutions 
of  higher  education  on  enrollment,  institutional  control  and  finance,  degrees 
conferred,  and  faculty  employment  and  salaries.    Other  information  is  obtained 
by  a  series  of  surveys  also  sponsored  by  NCES;  these  include  the  National 
Longitudinal  Study  of  the  High  School  Class  of  1972  (NLS),  HSB,  and  the  Survey 
of  Recent  College  Graduates.    In  an  October  supplement  the  CPS  collects  data 
on  college  enrollment  by  control  of  institution  (public  or  private),  and 
family  demographic  and  social  characteristics.    NSF  surveys  gather  data  on 
scientific  and  engineering  education.    The  Labor  Department's  longitudinal 
study  (NLS--Youth)  tracks  the  work  and  education  experience  of  young 
adults. 

Sometimes  specific  information  can  be  obtained  only  from  sources  outside 
of  the  government.    The  College  Board's  Annual  Survey  of  Colleges,  for  example, 
is  a  comprehensive  survey  that  queries  institutions  on  admissions  policies, 
student  charges,  standards,  and  fields  of  study.   The  American  Council  on 
Education  (ACE)  conducts  approximately  six  Higher  Education  Panel  (HEP) 
surveys  each  year  on  topics  of  special  interest.   The  National  Institute  on 
Independent  Colleges  and  Universities  (NIICU)  surveys  student  aid  in  private 
colleges;  the  National  Association  of  State  Colleges  and  Universities  collects 
an  analogous  public  college  survey.   The  Cooperative  Institutional  Research 
Program  (CIRP)  surveys  first-time  freshmen,  while  the  National  Association  of 
College  and  University  Business  Officers  (NACUBO)  quantifies  endowment  levels. 
As  further  examples,  the  American  Association  of  University  Professors  (AAUP) 
and  the  Council  for  Financial  Aid  to  Education  (CFAE)  report  faculty  salaries 
and  voluntary  support  to  higher  education,  respectively. 

Data  Coverage 

The  Reagan  administration's  1986  budget  recently  proposed  modifications  in 
the  federal  student  aid  programs  to  better  target  benefits  to  the  neediest 
students.    Documenting  the  trends  in  aid  recipients,  though,  has  proved  difficult 
and  controversial.   The  problem  is  not  that  the  information  is  insufficient, 
but  that  different  sets  of  data  are  disjointed  and  cannot  describe  the  total 
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student  aid  package  in  relation  to  students*  financial  need.    Once  again, 
the  problem  is  linkage  rather  than  coverage. 

The  efficiency  of  the  higher  education  production  process  is  another 
issue.    In  recent  years,  college  tuitions  have  risen  faster  than  the  inflation 
rate.    Has  efficiency  in  the  production  of  higher  education  changed?  Information 
to  address  this  qjestion  would  certainly  include  data  on  credit  hours  taught 
per  faculty  member,  time  divided  between  research  and  teaching,  and  clas2> 
size  and  unit  costs  of  different  course  offerings. 

HEGiS,  the  principal  federal  data  base  to  address  these  questions,  collects 
data  on  number  of  faculty  members  and  salaries,  enrollment,  revenue,  and 
expenditures.    Yet  HEGIS  data  do  not  help  us  answer  questions  of  efficiency. 
Faculty  salaries  are  not  reported  according  to  the  amount  of  time  spent  on 
research,  as  opposed  to   eaching.   And  information  is  not  provided  on  credit 
hours  taught  or  on  class  size  from  which  unit  costs  by  course  offering  could 
be  calculated. 

HEGIS  fiscal  data  are  aggregated  at  the  institutional  level,  a  practice  that 
precludes  reporting  resource  allocations  among  academic  departments  and 
levels.   The  extent  to  which  costs,  for  instance,  in  the  sciences  are  subsidized 
by  humanities  departments,  or  graduate  programs  by  undergraduates,  is  not 
available.    In  addition,  although  it  is  generally  assumed  that  the  expansion 
of  programs  and  course  offerings  has  been  costly  and  inefficient,  no  figures 
are  available  with  which  to  measure  the  expense  of  offering  a  multiplicity  of 
courses. 

Alternative  sources  for  certain  information  about  higher  education  inputs  are 
available,  but  little  is  known  about  the  efficiency  with  which  resources  are 
allocated.   The  AAUP  publishes  annual  salary  statistics  for  college  faculty 
by  rank  but  reports  nothing  on  teaching  loads.   It  has  been  suggested  (Noah, 
1985)  that  teaching  loads  have  been  cut  substantially  over  the  past  four 
decades,  yet  this  claim  cannot  be  corroborated  because  no  national  survey 
divides  faculty  time  among  teaching,  research,  and  other  endeavors. 

There  have  also  been  recent  expressions  of  concern  about  the  value  and 
diversity  of  the  college  course  of  study.    ** Although  more  than  50  percent  of 
Americans  high  school  graduates  continue  their  education  at  American  colleges 
and  universities,"  writes  Secretary  Bennett  (1984),  '•few  of  them  can  be 
said  to  receive  there  an  adequate  education  in  the  culture  and  civilization 
of  which  they  are  members. Information  on  course  enrollments  by  subject  area 
and  on  the  extent  of  remediation  would  be  helpful.   Test  scores  would  indicate 
what  students  actually  learned  in  courses.   The  apparent  growth  in  remediation 
would  suggest  a  "dumbing  down"  of  coursework  in  colleges.   Although  detailed 
information  is  available  about  the  major  fields  of  graduates,  little  is  known 
about  the  courses  graduates  took  outside  their  fieVds.   For  example,  HEGIS 
reports  the  number  of  men  and  women  receiving  degrees  in  home  management,  but 
not  the  number  of  courses  taken  by  students  who  major  or  do  not  major  in  the 
humanities.   ACE  surveys  indicate  total  credit  hours  in  selected  science  and 
humanities  programs,  but  the  data  do  not  permit  translation  of  these  credit 
hours  to  individuals. 
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TABLE  3:    VARIABLE  CATEGORIES  COVERED  BY  SELECTED  HIGHER  EDUCATIuN  DATA  BASES 

"  Student 
  Data  bases  Outcomes      Processes     Resources  backyround 


Education  Department 

Highei  Education  General  Information   

SiTvey  (HEGIS)  -  |_| 

N3Cional  Longitudinal  Study  of  the  High 

School  Class  of  1972  (NLS)  fN.  —  — 

High  School  and  Beyond  (HSB)  '       fN.               —  ,         —  \~\ 

Survey  of  Recent  College  Graduates  —  —  pX 

Other  Federal  Agencies 

Current  Population  Survey  (CPS)  fN^               —  —  1^ 

National  Science  Foundation  (NSF):  Surveys 
of  Science  and  Engineering  Expenditures, 
Feaeral  Support,  Personnel,  and  Graduates  — 

National  Longitudinal  Survey--Youth  Cohort   

(NLS— Youth)  (Labor  Department)  |_|  fN^  —  |_| 

Private  Organizations 

National  Institute  on  Independent  Colleges 

and  Universities  (NIICU):  Survey  of   

Student  Aid  Recipients  —  —  |  | 

National  Association  of  State  Colleges 

and  Universities  (NASCU):  Survey  of   

Student  Aid  Recipients  —  —  fN,  |  | 

College  Board:  Annual  Survey  of   

Institutions  —  |  |  fN^ 

Cooperative  Institutional  Research 
Program  (CI^^lM^  American  Freshman  Norms       —  — 

American  Council  on  Education  (ACE): 
Higher  Education  Panel  (HEP)  —  — 

National  Association  of  College  and 
University  Business  Officers  (NACUBO): 
Comparative  Performance  Study  and 

Investment  Questionnaires  —  —  f]s^ 

American  Association  of  University 
Professors  (AAUP)  ~  —  fS^ 

Council  for  Financial  Aid  to  Education  (CFAE)  —  ~  f\ 


I    I  «  Complete  data  Incomplete  data  «  Blank 
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Data  that  would  quantify  the  returns  to  a  college  education  in  terms  of  (' 
increasad  knowledge  also  are  lacking.    No  uniform  test,  such  as  the  Graduate 
Record  Examination,  is  given  to  a  representative  sanple  of  graduates  to  test  their 
general  knowledge.    One  study  of  changes  over  the  cast  two  decades  found 
significant  declines  in  graduate  admissions  test  scores  in  most  fields 
(Adelman,  1984),  but  these  results  were  not  drawn  from  statistically 
representative  sample  of  all  graduates,  because  only  those  intending  to  yo  to 
graduate  school  took  the  exams. 

Of  concern  is  the  quality  of  graduates  produced  by  various  programs  and 
in  different  fields,  particularly  graduates  of  teacher  education  programs. 
Beyond  the  NLS  study  of  menrbers  of  the  1972  high  school  class  who  went  into 
teaching,  little  definitive  is  known  about  the  quality  of  graduates  prepared 
to  teach.    The  Survey  of  Recent  College  Graduates  asked  for  grade-point 
averages,  but  this  measure  is  a  poor  indicator  of  quality  and  no  substitute 
for  college  transcript  data.    College  transcripts  would  give  not  only  grades 
but  actual  courses  that  would  suggest  the  extent  to  which  teaching  graduates 
are  fully  prepared  in  their  subject  matter  or  were  enrolled  in  watered-down 
courses. 

Concern  has  also  arisen  over  the  mission  of  higher  education  in  relation 

to  other  providers  of  postsecondary  training.    Some  observers  charge  that 

higher  education,  particularly  in  community  colleges,  has  become  indistinguishable 

from  vocational  training.   Conversely,  corporate  training  is  being  provided 

in  areas  traditionally  reserved  for  universities  and  colleges.  These 

developments  suggest  the  need  for  information  about  the  extent  of  the 

overlap  and  the  relationship  between  training  provided  by  businesses  and  ( 

postsecondary  institutions.    For  that  matter,' the  academic-occupational  mix 

in  college  programs  remains  an  important  unknown,  critical  to  assessing 

higher  education's  role  in  relation  to  the  role  of  other  postsecondary 

providers. 

Data  Quality 

Although  many  data  sets  provide  information  about  the  specific  policy 
issues  raised  here,  multiple  sources  often  result  in  conflicting  and  Incomplete 
overall  higher  education  policy  evaluations.    Both  the  HEGIS  and  CPS,  for 
example,  report  enrollment,  but  tabulations  differ  even  for  this  most  basic 
statistic.   The  two  surveys  basically  agree  on  total  enrollment  but  show 
discrepancies  by  full-time/part-time  status  and  4-year/2-year  disaggregations 
and  wider  differences  by  graduate/undergraduate  breakdowns.    For  example,  CPS 
estimates  graduate  school  enrollment  to  be  one-third  larger  than  the  figure 
reported  through  HEGIS,  although  U  other  categories  CPS  finds  fewer  students 
than  HEGIS. 

Although  HEGIS  remains  the  federal  government's  primary  instrument  for 
monitoring  higher  education,  the  periodicity  of  many  of  these  surveys  has 
been  interrupted  in  recent  years.   Because  of  processing  delays  and  technical 
difficulty,  NCES  has  abandoned  attempts  to  release  the  1982-83  data  on  faculty 
salaries  and  some  of  the  financial  and  degrees  data.    Even  in  years  without 
abnormal  delays,  HEGIS  data  were  not  available  to  analysts  until  approximately 
two  years  after  the  surveys  were  taken. 
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Data  Linkages 

major  problem  associated  with  higher  education  data  is  that  information 
•-^um  muUiple  sources  cannot  be  combined  to  form  a  complete  picture.  The 
relationship  between  student  aid  and  financial  need  provides  an  example  of 
the  lack  of  linkage  among  data  sets  and  the  difficulty  this  causes  to  analysts. 

Any  evaluation  of  student  aid  programs  requires  an  understanding  of  the 

income  distribution  of  students*  families  and  the  types  and  amounts  of  aid 

these  students  receive.  These  are  important  policy  considerations,  especially 
given  the  debate  over  proposed  federal  funding  reductions. 

The  fundamental  problem  with  student  aid  information  is  that  it  is  collected 
for  administrative  purposes  by  those  responsible  for  each  program.  Hence, 
coverage  may  not  be  a  problem,  but  organization  is.    Because  the  information 
is  generally  not  consolidated  into  files  that  cover  all  student  aid  programs, 
it  is  impossible  using  federal  data  bases,  to  determine  how  the  need  for 
student  aid  is  distributed  and  how  federal  aid  combines  with  other  revenue 
sources  to  meet  this  need. 

Two  private  sources  of  student  aid  information,  however,  cut  across  programs 
and  could  provide  the  needed  data.    Identical  questionnaires  concerning 
student  aid  are  sent  to  both  public  and  private  institutions  for  the  National 
Association  of  State  Colleges  and  Universities  (NASCU)  and  the  National 
Institute  on  Independent  Colleges  and  Universities  (NIICU),  respectively. 
These  surveys  could,  if  merged,  provide  the  information  needed  for  policy 
analysis  and  discuf>sion.    The  Education  Department  can  obtain  the  NASCU 
public  college  data,  but  NIICU  will  not  make  available  the  private  college 
data  tapes. 

The  problem,  again,  is  that  much  of  the  information  useful  for  analyzing 
the  higher  education  process  is  piecemeal,  serving  only  the  specific  needs  of 
the  originating  agency.    Some  national  coordination  for  these  blocks  of 
data  would  vastly  improve  the  information  base. 


RECOMMENDATIONS  FOR  IMPROVING  NATIONAL  DATA 

The  tremendous  national  interest  in  educational  improvement  provides  the 
impetus  for  reform  of  our  national  base  of  educational  statistics,  but  the 
task  will  not  be  easily  accomplished.    Inertia  and  special  interests 
will  work  against  developing  a  coherent  data  collection  strategy.  Policymakers 
may  be  unwilling  to  wait  for  real  Improvements. 

Given  these  problems,  identifying  a  clear  agenda  becomes  all  important 
for  improving  national  statistics.   Extensive  analysis  is  needed  before  a 
complete  set  of  reforms  can  be  specified.   Analysts  must  carefully  investigate 
the  design  options  for  data  collection  before  final  decisions  on  implementation 
are  made.    Resource  and  political  constraints  also  will  impose  trade-offs 
among  options.   Our  purpose  in  setting  forth  this  agenda  is  to  identify  the 
most  important  directions  for  reform.    We  have  divided  our  recommendations 
along  the  three  types  of  evaluation  criteria  used  throughout  this  paper: 
data  coverage,  data  quality,  and  data  linkages. 
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Data  Coverage 

The  federal  government  needs  to  ask  the  important  questions  and  collect 
data  accordingly.    It  already  collects  a  considerable  amount  of  educationally 
related  data,  but  some  of  the  data  now  collected  may  have  relatively  little 
policy  value,  whereas  other  data  not  now  gathered  may  have  high  informational 
value. 

Recommendation  1:    Eliminate  low  priority  data  items. 

The  continued  collection  of  data  with  little  policy  worth  cannot  be 
justified     A  comprehensive  reconsideration  of  survey  instruments  requires 
a  item-by-item  analysis,  but  various  candidates  for  paring  are  evident. 
They  include  the  following: 

0  Annual  HEGIS  collection  of  degrees  awarded  by  sex,  for  six- 
digit  degree  codes  at  the  subbaccal aureate  level  that  include 
facts  such  as  the  number  of  female  degree  recipients  in  fashion 
merchandising  or  jewelry  marketing; 

0  Library  statistics  on  book  binding  costs  and  number  of 
audiovisual  materials;  and 

0  Annual  CCD  collection  of  school  district  finances  detailing 
expenditure  and  revenue  statistics  for  all  16,000  school  districts. 

Reconunendation  2;  Identify  and  fill  information  gaps  on  a  priority  basis  in 
areas  of  major  policy  interest. 

Some  gaps  in  the  data  can  be  filled  by  adding  items  to  existing  surveys 
without  incurring  substantial  costs,  and  these  efforts  should  proceed. 
Examples  include: 

0  Adding  questions  on  preprimary  education  to  the  CPS  to 
differentiate  provider  types  and  extending  coverage 
of  this  item  to  estimate  the  number  of  children  In 
home  day  care; 

0  Requesting  teacher  salary  data  by  state  as  a  regular  part  of  the 
CCD; 

0  Including  on  the  CPS  a  question  on  how  high  school  was  completed, 
whether  through  graduating  from  a  regular  4-year  program  or  by 
earning  an  equivalency  certificate  or  external  degree; 

0  Adding  questions  to  HEGIS  about  number  of  faculty  hours  spent 
teaching  as  a  rough  measure  of  instructional  load;  and 

0  Adding  a  college  transcript  collection  to  the  Survey  of 
Recent  College  Graduates. 
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Supplementing  existing  surveys  will  not,  by  itself,  produce  much  of  the  new 
r  data  needed  to  resolve  many  of  the  most  glaring  deficiencies  in  policy 

information  needs.   These  deficiencies  include  the  following: 

0  Preprimarv  education.   Little  is  known  about  the  oroanizatio.i 
and  support  for  preprimary  education,  the  nature  or  quality 
of  these  programs,  and  the  relationship  between  preschool  and 
home  learning. 

0  Elementary  school.    No  recent  study  describes  how  course 
content  relates  to  outcomes.   Of  special  interest  at  this 
level  would  be  information  on  the  use  and  effectiveness  of 
alternative  teaching  approaches  to  development  of  reading  and 
mathematics  skills.    NAEP  may  begin  to  yield  information  on 
coursework  in  the  4th  grade,  but  additional  data  are  needed  to 
describe  how  learning  at  this  level  relates  to  learning  before 
and  after  this  grade. 

0  Junior  high  school .    Two  areas  deserve  special  attention: 
First,  the  adolescent  years  are  ones  in  which  behavioral 
problems  of  students  become  serious.   Many  youths  may  drop 
out  of  school  at  this  level,  yet  national  data  about  attrition  in 
Junior  high  is  lacking.    Information  on  how  discipline  and 
dropout  problems  develop  may  require  longitudinal  data  collection 
at  the  junior  high  level.  Second,  deficiencies  in  higher-order 
thinking  skills  surface  in  adolescence,  and  these  deficiencies  need 
to  be  related  to  course-taking  and  schooling  processes. 

( 

0  Higher  education  student  aid.   The  primary  problem  is  the  absence 
of  a         for  each  student  that  shows  aid  from  all  sources  in 
relation  to  need.   This  consolidated  record  is  essential  for 
analyzing  the  effects  of  student  aid  reforms. 

0  College  learning.   Except  for  the  number  of  degrees  granted  and 
the  unrepresentative  graduate  admission  exam  scores,  there  is 
little  or  no  information  on  the  learning  that  takes  place  in 
college  or  even  on  the  distribution  of  coursework. 

This  rather  long  list  unfortunately  reflects  the  sorry  condition  of  current 
national  statistics.    In  view  of  financial  and  staff  limitations,  priorities 
must  be  established.   Attention  must  be  paid  to  state-of-the-art  problems  in 
developing  designs  that  yield  reasonably  cost-effective  information  payoffs. 
Examples  of  the  difficulties  involved  in  conducting  surveys  include 
the  following: 
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0  Preprimary  education  occurs  in  myriad  settings,  the  most  important 
of  which  may  be  the  home.    The  universe  of  settings  is  poorly  defined; 
master  lists  to  draw  samples  often  do  not  exist.   Distinctions  between 
nursery,  kindergarten,  preschool,  and  day  care  may  be  only  nomina.. 
Studying  classroom  processes  at  the  preprimary  level  may  require  the 
use  of  detailed  and  costly  observational  techniques. 

0  Previous  attempts  to  measure  schooling  processes  at  the  elementary 
level  have  yielded  little  useful  information.   The  Sustaining 
Effects  Study,  a  $20  million  longitudinal  study  in  the  mid-1970s, 
thoroughly  examined  elementary  schools,  yet  told  very  little  about 
effective  elementary  schools  and  classrooms.   For  that  matter,  it 
even  failed  to  achieve  its  primary  objective  of  settling  the  debate 
over  the  long-term  effectiveness  of  compensatory  education  programs. 

0   Colleges,  in  particular,  and  postsecondary  institutions,  in  general, 
are  extremely  diverse,  and  it  is  not  at  all  clear  how  to  measure 
outcomes  for.  these  institutions. 

In  view  of  these  methodological  and  definitional  considerations  and 
differing  policy  priorities,  experts  will  disagree  over  subjects  to  pursue. 
Among  this  list,  ttie  two  activities  we  recommend  for  highest  initial  priority 
are  these-  (1)  the  junior  high  school  study,  because  schooling  in  these 
grades  may  be  the  key  to  rejuvenating  the  high  school  and  because  so 
little  is  known  about  processes  at  this  level;  and  (2)  the  student  aid 
study,  because  this  issue  is  of  extreme  immediate  importance.    In  other- 
areas,  conceptual  and  measurement  efforts  are  clearly  needed  and  should 
begin  at  once.    For  example,  efforts  to  separate  educational  from  custodial 
services  at  the  preprimary  level  and  to  develop  of  appropriate  measures 
of  learning  at  the  college  level  should  be  pursued. 

Data  Quality 

Inaccuracies  and  inconsistencies  in  Education  Department  statistics  pose 
serious  problems.    Once  data  are  published,  they  become  accepted  as  fact, 
regardless  of  the  caveats  that  may  accompany  their  publication.    In  some 
instances,  the  reader  is  not  even  warned  of  data  weaknesses.   These  concerns 
over  data  quality  are  not  new  ones,  but  seemingly  they  arise,  year  after 
year,  with  little  inprovement.   The  Education  Department  should  immediately 
begin  to  address  the  problems  of  improving  the  adequacy  of  its  data. 

Reconmendation  3:  Establish  an  office  of  quality  control. 

No  such  office  now  exists  within  the  Education  Department,  nor  has  any 
office  promulgated  a  set  of  standards  to  ensure  adequate  data  quality.  An 
office  that  has  this  function  as  its  primary  responsibility  is  essential 
to  the  job  of  inproving  data  quality.   This  office  should  be  independent  of 
the  data-collecting  offices  and  should  oversee  data  collection  of  both  general 
purpose  statistics  and  program  data. 
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Recommendation  4;    Give  highest  priority  to  improving  the  quality  of  elementary 
and  secondary  education  data. 

Although  all  information  must  be  subject  to  quality  control  reviews,  the 
most  • 'aring  accuracy  problems  relate  to  elementary  and  secondary  education 
data.'  The  states  must  be  held  accountable  for  providing  the  Department  of 
Education  with  consistent' and  accurate  data. 

The  failure  of  certain  data  to  pass  muster  when  subjected  to  external 
validity  checks  must  be  immediately  addressed.    In  particular,  differences 
between  NCES  and  Census  Bureau  data  on  estimated  dropout  rates  and  private 
school  attendance  can  no  longer  oe  ignored  simply  because  of  organizational 
divisions  at  the  ""-deral  level.    The  two  organizations  should  immediately 
establish  a  joint  ■    ^ew  group  to  assess  the  reasons  for  inconsistencies  in 
the  data  each  colltv.... 

Recommendation  5:    Modernize  procedures  for  data  collection. 

NCLS  has  had  problems  of  providing  timely  data,  especially  with  some  of 
its  larger  surveys  such  as  CCD  and  HEGIS.    Several  types  of  reforms  could 
improve  the  currency  of  information.    Using  the  telephone  Instead  of  a  mailed 
questionnaire  would  speed  collection  of  school  universe  data.   When  there 
are  a  limited  number  of  respondents,  such  as  50  states,  computer  networks 
seem  to  be  a  sensible  approach.    Once  data  are  collected,  they  should  not 
languish.   Analysis  contracts  should  be  built  into  the  overall  data  collection 
effort  to  expedite  reporting  of  the  data. 

Data  Linkages 

The  number  of  distinct  data  collection  instruments  related  tc  education  is 
quite  large.   The  approximately  35  data  bases  reviewed  in. this  study  are  only  a 
partial  listing.   These  activities  lack  cohesiveness.    Although  a  master 
plan  relating  all  data  collection  efforts  would  be  quite  unwieldy,  far  too 
little  attention  is  now  paid  to  tha  advantages  that  could  be  derived  from 
coordinating  or  combining  related  efforts. 

Nc  one  reason  explains  why  coordination  of  national  data-gathering  activities 
has  not  progressed.   Sometimes  the  reasons  are  historic.    New  data  collections 
were  planned  for  specific  purposes  and  tn-i  planners  paid  inadequate  consideration 
to  whether  these  purposes  could  be  better  met  through  existing  activities. 
Moreover,  data  needs  may  be  defined  io  narrowly  that  the  benefits  of  an 
integrated  data  set  are  not  perceived.    At  other  times,  the  problem  is 
bureaucratic.    It  is  unnatural  to  expect  one  statistical  division  or  agency 
to  transfer  its  re-jponsibility  to  another.   Whatever  the  reason,  the  limited 
federal  funds  available  for  education  statistics  make  coordination  of  dati 
activities  imperative. 

Steps  the  Education  Department  should  consider  to  strengthen  linkages  anong 
its  statis   cal  activities  include  the  following: 
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Recommendation  6:  Investigate  the  feasibility  of  linking  the  most  costly  data 
collection  systems  in  the  Department  of  Education, ] 


Longitudinal  data  and  performance  assessments  are  acknowledged  to  be 
high-budget  items.    If  we  can  detach  ourselves  from  the  ways  d^ta  systems  are 
currently  organized  and  administered,  we  may  see  some  alternatives  for  collecting 
information.    Take,  for  example,  the  NAEP,    Many  would  say  thut  NAEP  has  had 
limited  usefulness  because  it  could  not  be  linked  directly  to  school  policies 
and  practices.    Prior  to  the  1983-84  assessment,  performance  measures  could 
be  tied  to  only  a  few  student  characteristics  and  to  no  curriculum  or  process 
variables.    The  recent  release  of  preliminary  NAEP'data  suggests  that  the 
inclusion  of  fairly  comprehensive  student  and  teacher  questionnaires  vill 
prove  most  valuable. 

Other  tie-ins  to  major  outcome  assessment  activities  should  be  considered. 
In  particular,  the  question  should  be  raised  as  to  whether  the  distinctions 
between  repeated  cross-sectional  studies,  such  as  NAEP,  and  longitudinal  studies, 
such  as  HSB,  are  real  or  artificial.    For  example,  attaching  a  small  longitudinal 
component  to  the  NAEP  7th  grad*?  sample  might  provide  a  measure  of  the  extent 
of  attrition  at  this  early  level.    The  r*»lationship  among  longitudinal  surveys 
also  should  be  considered,  such  as,  for  instance,  how  NCES  longitudinal 
surveys  could  be  coordinated  with  the  Labor  Department's  NLS— Youth  survey 
which  also  obtains  longitudinal  cohort  data.    Both  HSB  and  Labor's  Youth 
Cohort  have  transcript  studies  that,  coi nci dentally,  are  being  directed 
by  the  same  contractor. 

Recommendation  7:    Initiate  informal  discussions  with  representatives  of 
Departments  of  Education,  Health  and  Human  Services,  and  L<bor,  and  the 
Bureau  of  the  Census  to  coordinate  data  collections. 

Data  collectors  in  the  private  sector  also  should  be  brought  in  to  the 
discussions. 

Recommendation  8:  Consider,  when  developing  questionnaire  Items,  those  variables 
that  have  been  shown  to  be  most  Important  to  educational  outcomes. 

Statisticians  and  survey  monitors  <5hould  draw  upon  recent  school  effecti  eness 
studies  to  help  frame  survey  instruments. 

Recommendation  9:  Establish  an  education  data  bank  to  improve  survey  consistency 
across  data  bases  and  over  time. 

This  data  bank  would  pool  items  related  to  education  within  and  outside 
government  and  might  include  items  used  in  state  and  local  surveys  and  case 
s  .udies. 

Recommendation  10:    Keep  expectations  high. 

We  might  take  a  cue  from  recent  research  on  HSB  which  shows  the  power  or 
positive  thinking  and  persistence  on  student  performance.    Despite  limited 
funds,  national  data  collections  can  be  improved.    Because  funds  are  limited, 
greater  efficiency  it  is  important  to  promote  in  our  information  systems.  In 


addition,  data  producers  should  call  attention  to  and  take  credit  for  the 
(  policy  payoffs  from  study  findings. 

In  addressing  1985  college  graduates,  Secretary  Bennett  offered  some 
sound  advice:  "It  is  practical  optimism  that  I  recommend."    As  we  consider 
reforming  national  statistical  collections,  we  must  think  practically 
and  optimistically  about  the  task  ahead. 
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NEW  AREAS   FOR  EDUCATIONAL  DATA  COLLECTION: 
WHAT  STUDENTS  ARE  TAUGHT  AND  WHAT  THEY  LEARN 


Elizabeth  R.  Reisner 
Policy  Studies  Associates 


In  the  next  several  years  pressures  are  likely  to  grow  for* 
the  federal  government  to  expand  its  reporting  of  what  elementary 
and  secondary  students  are  taught  and,  from  the  instruction  to 
which  they  are  exposed^  how  much  they  learn.  Gathering  accurate 
data  in  these  two  area:  will  present  major  challenges  both  to  the 
National  Center  for  Education  Statistics^  because  of  the  tech- 
nical problems  of  survey  and  analysis  design^  and  to  its  parent 
the  U.S.  Department  of  Education^  because  of  the  policy  debate 
these  proposals  and  plans  will  inevitably  provoke.  To  meet  these 
challenges^  NCES  should  begin  now  to  consider  approaches  for 
gathering  and  reporting  data  on  (1)  the  curricular  content  of 
elementary  and  secondary  instruction  and  (2)  students'  achieve- 
ment of  the  curricular  goals  that  are  set  for  them. 

This  paper  provides  an  overview  of  topics  related  to  federal 
data  collection  in  these  areas.  The  first  section  reviews  the 
current  need  for  such  data.  The  second  section  explores  how  data 
in  these  areas  could  actually  be  collected.  The  third  section 
surveys  several  problems  to  be  addressed  in  designing  these  data 
collection  activities. 
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Why  We  Need  Better  Information  in  These  Areas 

f 

At  present  federal  agencies  provide  extensive  information  on 
many  aspects  American  education.  For  example,  comprehensive 
information  is  available  on  what  have  been  termed  the  inputs  of 
the  American  education  system;  these  include  the  characteristics 
of  participating  students,  the  fiscal  resources  available  to  ele- 
mentary and  secondary  education,  the  structure  established  to 
govern  educational  activities,  and  other  components  of  the  sys- 
tem. We  also  know  something  about  the  processes  that  affect  edu- 
cation, including  the  interlocking  character  of  governance  deci- 
sions at  local,  state,  and  federal  levels  and  the  supply,  assign- 
ment, and  supervision  of  teachers  and  other  staff.  With  regard 
to  educational  outcomes,  we  know  how  students  score  on  tests  that 
measure  knowledge  and  critical  thinking,  using  standard  test  ^ 
items  for  students  in  very  different  schools  and  localities. 

These  measures  do  not,  however,  permit  us  to  form  generali- 
zations about  the  curricular  content  of  instruction  or  students' 
mastery  of  that  content.  For  example,  although  we  may  know  that 
high  school  students  in  a  given  state  complete  an  average  of 
three  units  of  mathematics  prior  to  graduating,  for  most  states 
we  do  not  know  what  proportion  of  graduating  students  take 
Algebra  II,  Trigonometry,  or  Calculus,  nor  do  we  know  what  mathe- 
matical skills  and  concepts  are  typically  taught  in  each  of  these 
mathematics  courses  I n  a  state.  Without  such  information,  we 
cannot  legitimately  compare  the  mathematics  program  in  one  state 
with  the  program  of  another  state  whose  graduates  typically 
complete     fewer     units     of     mathematics     prior     to  graduation. 
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Wil.rly,  without  d,t.  describing  students'  .astery  ot  the 
;..en.tics  curriculum  in  their  schools.  «e  cannot  conclude 
...ether  the  completion  of  three  units  ot  mathematics  in  a  state 
generally  results  in  ,1.  ...tery  of  .  l.r,er  r.n,e  of  .athe.a- 
Uc.l  .Kill,  .nd  concepts  .nd  (2,  .ore  thorough  mastery  than  .s 
schieved    in    .   state   -hose    student,   generally    complete  fewer 


units* 


It  I.  not  .urprislng  that  the  federal  government  ha.  avoided 
collecting  detailed  data  in  these  areas.  A.  discussed  later  .n 
this  paper,  it  Is  a  particularly  difficult  thin,  to  do. 

Nevertheless,  f...  ta..  I.  Important,  a.  Illustrated  in  three 
recent  reports  on  proposal,  for  change  In  higher  education 
,Bennett.  1«4,  National  Institute  of  education,  and  .sso- 

elation   Of   American  Colleges,    »65,.      The  three   reports  looK 
crltlcauy  at  the  content  of  current  undergraduate  curricula  an 
propose   ways   of   upgrading    It.      ..cause   of   the   .parsity  o 
national    data   on   undergraduate    curricula,    the   conclusions  of 
these   report,  are  basad  on  anecdotal  .vld.nc.  of  what  college 
curricula  currently  Include  and  on  .mall-scale  survey,  of  course 

titles  m  ..lectad  coll  nd  unlv.r.ltle..    U  the.,  data  were 

^re  complete,  the  authors  of  these  reports  would  he  aMe  to  ma.e 
tnelr  recommendation.  «,re  per.ua.lv.ly  and   Indeed  might  f.nd 
greater  congruence  among  their  analyses.    Similarly,  the  lac.  o 
..ta    on    the    content    of    alementary    and    secondary  schooUng 

1  .4.  ftf  the  extent  to  which  students  are 
precludes  accurate  analysis  of  the  exce 

«    4n   .kills   and   subject   areas   needed  for 
receiving    instruction   in  skills 

i^i.^m  4nfo  these  postsecondary  programs, 
successful  transitions  into  tne»e  v 


433 


445 


our  lack  of  informatiok  on  what  students  are  taught  and  what 
they  learn  makes  it  difficult  for  us  to  analyze  the  fit  between 
elementary  and  secondary  schooling  and   the  range   of  post-high 
school  paths  taken  by  young  adults.     For  students  going  on  to 
postsecondary  schooling,  college  and  university  planners  need  to 
know  what  content  and  skills  have  been  presented  to  high  school 
students  in  order  to  design  appropriate  entry-level  courses;  in 
particular,  postsecondary  planners  need  to  know  how  the  content 
of  high  school  programs  is  changing,   in  order  to  adjust  entry- 
level  undergraduate  courses  accordingly.  For  example,   if  recent 
national   attention   to  science   and  mathematics    instruction  has 
actually  increased  students'   exposure  to  and  mastery  of  skills 
and  information  in  these  areas,  entry-level  undergraduate  courses 
in  science  and  mathematics  should  be  upgraded  to  reflect  these 
changes.     For  high  school  graduates  moving  directly  Into  jobs, 
postsecondary  vocational  training,  or  military  service,  analysis 
of   high   school   course   content,    students'    mastery   of    It,  and 
trends  In  content  and  mastery  can  Indicate  whether  high  schools 
.re     adequately    preparing    studsnts    for     changing  vocational 
requirements  and  whether  changes  at  the  high  school  level  reflect 
trends  In  job  requirements. 

These  data  are  also  needed  for  other  policy  purposes.  For 
example,  they  can  provide  a  yardstick  for  educational  agencies  to 
compare  their  own  program,  and  performance  with  those  of  com- 
parable agencies.  This  information  can  help  them  identify 
instructional  areas  of  relative  weakness  and  strenath.  Data  on 
instructional  content  and  mastery  can  also  provide  a  baseline  for 
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agencies  to  assess  changes  in  their  ptoqcams  and  student  perfor- 
mance over  time.  This  type  of  analysis  is  more  useful  than  a 
static  comparison  of  an  agency's  program  and  performance  across 
two  points   in  time  because   it  permits  comparison  with  changing 

national  trends. 

At  the  broadest  policy  level,  these  new  data  are  needed  to 
address  growing  demands  for  accountability  in  the  expenditure  of 
public  funds.  AS  the  competition  for  limited  tax  revenues 
becomes  more  intense,  legislative  bodies,  the  media,  and  tax- 
payers increasingly  require  that  the  value  of  educational  and 
other  social  service  expenditures  be  concretely  justified.  These 
demands   are   likely   to  be  particularly   insistent   in  the  states 

that  have   recently  enacted  educational  reform  proposals  -  and 

ne«  revenue  raising  and  spending  plans  to  implement  them. 

These    growing    requirements    for    programmatic    and  fiscal 

accountability   provide   our   backdrop    for   consideration   of  how 

these  needs  can  be  addressed. 

HOW  to  Obtain  Better  Data  on  Curriculum  and  Achievement 

information  on  curriculum  is  considerably  easier  to  obtain 
than  information  on  students'  mastery  of  it.  In  either  instance 
It  is  essential  that  information  requests  be  limited  to  the 
minimum  needed  to  yield  simple  data  capable  of  meeting  the  needs 
already  discussed.  For  purposes  of  designing  data  collection 
procedures,  those  needs  may  be  summarized  as  requirements  for 
baseline  measures  that  permit  the  following: 
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•  Comparison?  across  educational  agencies  to  assess 
relative  status 

•  CoiT\par isons  across  time  to  assess  change  in  educa- 
tional agencies 

•  Planning  by  post-high  school  providers  of  et^cation 
and  training,  including  insti tut  ions  of  higher 
education ,  post secondary  vocational  proqrams  #  and 
the  military 

•  Assessment  by  the  public  to  determine  if  expecta- 
tions for  educational  delivery  and  performance  are 
being  met 

The  following  discussion  focuses  first  on  how  NCES  could  obtain 
data  on  the  content  of  students'  curriculum  to  address  these 
requirements.  Then  we  turn  to  procedures  for  obtaining  data  on 
the  extent  to  which  students  learn  the  skills  and  information 
contained  in  the  curriculum. 


Instructional  Content  and  Methods 

The  first  step  in  designing  procedures  to  collect  data  on 
curricular  content  is  to  decide  exactly  what  information  is 
necessary.  Possible  information  categories  include  for  any  given 
subject  area  (e.g.,  mathematics,  language  arts): 

•  Courses  of  study  offered  at  each  grade,  including 
which  are  required  and  which  are  elective 

•  Student  enrollment  in  each  course 

•  Major  skills,  concepts,  and  information  taught  in 
each  course 

•  Local  or  state  guidelines  for  skills,  concepts,  and 
information  to  be  taught  in  each  course 

•  Primary  teaching  techniques  used  in  each  course 
(e.g. ,  laboratory  or  activity-centered;  classroom 
discussion;  extensive  use  of  audio-visual  materials, 
computers,  or  self •instructional  materials) 
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.    subject-relevant  '  '  yeVrs^'"cf 

preservice    training,    inservice  training. 
experience    in    teaching    the  course) 
teaching  each  course 
,    Role    of    subject    supervisors    or    specialists  in 

teaching  (or  shaping)  the  course 
These  information  categories  are  derived  fro»  those  used  in 
a  study  conducted  by  «eiss  for  the  National  Science  foundation, 
entitled    -1917    National    Survey    of    Science,    Mathematics,  and 
social   Studies  Education.'      The  .urvey  -as  d.slgn.d  to  obtain 
data    on    course    offerings,     curriculum    usage,    and  classroom 
practices  in  science,  mathematics,  and  social  studies.  Besides 
taking    a    snapshot    of    Instruct io...l    practice    in    these  three 
subjects,  ssr  used  the  survey  to  determine  the  extent  to  which 
NSF-sponsored   material.  «e.e  being  used   in  classrooms   and  the 
self-reported   influence   of  Nsr-sponsored  program,   of  Inservice 
training  on  .eience,  mathematle.,  and  social  studies  instruction. 
TO  improve  the  quality  and  comprehensiveness  of  the  survey,  an 
important  design  step  -as  the  review  of  the  draft  questionnaire 
by  a  large  group  of  consultants  with  appropriate  subject  matter 
expertise  and  representative,  of  professional  associations  with 
interest,  in  .eience.  -athematlc  and  .ocial  .tudie.  education. 

Another  per.pectiv.  on  the  collection  of  instructional  data 
i.  provided  by  a  1«1  .urvey  conducted  for  the  Committee  on 
Economic  Education  of  the  American  Econ«.ic  Association  by 
VanKelovich,  SKelly  and  White,  Inc.  The  purpose  of  this  survey 
«s  to  examine  "how  economics  is  being  taught  in  America,  i.e., 
-ho  is  teaching  it,  -here  it  I.  placed  in  the  school  curriculum, 
-hat  the  focus  is,  and  -hat  teaching  aid.  and  material,  economics 

449 

437 


teachers  are  using."  As  in  the  tiS'/  project,  a  number  of  ertpert 
consultants  and  association  representatives  were  involved  in 
survey  design  and  analysis.  This  survey  collected  data  in 
categories  similar  to  the  seven  listed  at  the  beginning  of  this 
section. 

The  economics  survey  is  particularly  relevant  to  the  propo- 
sal presented   in  this  paper  because  it  reported   information  on 
the    Instructional   content   of   economics   courses,    using  several 
sets  of  focused  subcategories.     For  example,  within  the  category 
labeled  "major  skills,  concepts,  and  information  taught  in  each 
course"  in  the  list  above,  the  economics  education  survey  breaks 
out  two  sets  of   subcategories.     The  first  is  called  "goals  of 
economic  education"  and  offered  respondents  the  choice  among  six 
possible  goals,   including  "to  help  students  understand  the  cur- 
rent problems  facing  the  country"   (reported  as  a  very  important 
goal   by  66  percent  of   all  responding  teachers)   and   "to  teach 
students  practical  skills  that  they  need  in  their  everyday  lives, 
such  as  balancing  a  checkbook,  using  credit  cards,  how  to  shop 
wisely,    etc."    (reported    as    Important    by    65    percent    of  the 
respondents).     The  survey  also  breaks  out  a  second  set  of  infor- 
mation   categories    focused    on    "aspects    of    economics";  these 
Include    23    headings    such    as    "supply    and    demand"    (the  most 
frequently    taught   aspect    of   economics)    and    "consumer  issues/ 
consumerism"   (an  aspect  taught  by  66  percent  of  all  responding 
economics  teachers). 

These  two  surveys  demonstrate  the  feasibility  of  obtaining 
nationally    representative    data    on    Instructional    content  and 
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.         H-«irability  of  conducting  survey 
:r.ethods.    They  also  suggest  the  desirability 

.    «enarately    for    each    major    subject  area, 
development    separately  . 

*  -vn-rt  review  panels,  such  as 
strategy  would  permit  the  use  of  expert  revie 

ed  in  these  two  surveys.     The  panels  could  play  valua^^.e 
those  used  in  these  cwo  »       j  ^«««ries 
in  t..  review         ..option  o.  .u.J.ct  -.tt.r  c.te,or>es 

.v,U..U   m  ot..r  su...ct  «...  .na  .r.  .o....»«  "U.a 
-taxonomi.s  o£  *Juc.tion.l  obj.ctl...." ) 

l„ilMir.- -Y        'nstrurtion.1  Cont.nt 

pr.c.ain,  ..ction  .u„..»  tH.t  .ny  t.stin,  .tu.ent.. 

•     i.r   noals    in   a  particular   subject  area 
achievement   of    curricular   goals  map 

.....  not  occ«  until   .,r...ent  ..ists  on  .  -i.«.te  ..t  o. 
o.,ectiv.s  or  topic   eor  tn.t  ....ect  «...      .t  t..t  po  n 

o.,.cti..  -ithin  .  .u.3.ct  «...     0.vio«l,.  tH..  proc... 
1  .  .  ..  c«..i  .n.  pr.ci..  ..  t..  — J  7 
c.t.,ort.,.  in  or..r  .or  tH.  t..t  it.».  .or  .  p.rti=ul.r  top.c 
.  ,iv.n  ,r.a.  to  «.t  crit.ri.  .uc^  ..  tH.  .oUo«.: 

.   .ecur.t.  -.-•"ror'aVr'to*  ^.'^irVri.^l'Tf 

X  n  Kr*adth  of  Content  com- 

•  rn!r-.ht"ircUV.ctfoi  5i%%"."'p.rti=uur  o.:.c- 

tive  or  topic 

^  of  differing  types  of  achievement  sought 

•  ;j!*„rr;ir?Ity'o/\'ealhin^g'methods 

...ough  other  criteria  will  .e  necessary  as  well    these  ind.a.e 
..e  Challenges  in  designing  standard  test  items  tailored  to  vary 
ing  instructional  content  and  methods. 
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Test  administration  will  require  that  students  be  examined 
using  the  test  items  that  correspond  to  the  objectives  or  topics 
on  which  their  instruction  has  focused.  Test  results  under  this 
procedure  will  be  a  more  accurate  measure  of  the  effectiveness  of 
instruction  than  is  currently  the  case  with  the  use  of  general 
tests  of  educational  achievement. 

Depending  on  the  intended  policy  uses  of  the  test  results, 
tests  can  be  tailored  to  instructional  objectives  at  any  organi- 
zational level  desired  (e.g.,  school^  district #  or  state).  For 
example,  if  a  state  has  established  improved  mathematics  cor.pu- 
tation  as  a  major  statewide  goal,  all  local  agencies  may  be 
required  by  the  state  to  test  all  students  in  that  area.  Local 
agencies  could  then  be  permitted  to  administer  tests  of  other 
mathematics  objectives  (e.g.,  mathematical  reasoning)  according 
to  local  priorities.  The  ability  to  tailor  such  state-level  uses 
for  the  tests  will  be  a  major  factor  in  encouraging  voluntary 
participation  in  test  development  and  administration  and  even 
cost-sharing. 

Problems  Likely  To  Be  Encountered  in  Implementing  This  New  Data 
Collection  Focus 

Before  implementing  this  proposal,  it  will  be  necessary  to 
address  and  resolve  four  sets  of  problems,  as  described  below. 

Problems  in  reaching  agreement  among  educational  interests 
affected  by  the  proposal.  This  proposal  may  be  seen  as  intruding 
on  state  and  lucal  prerogatives  in  the  educational  enterprise, 
because    it   would    require   educational    agencies    to    reveal  the 


priorities  they  place  on  different  areas  of  the  school  cum- 
culun*  If  widely  held#  this  perception  pay  require  that  NCES 
distance  itself  soniewhat  from  the  developmental  process.  One  way 
to  do  this  will  be  to  rely  heavily  on  the  involvement  of  (1) 
advisors  who  are  recognized  as  experts  in  curricular  areas  and 
(2)  representatives  of  professional  associations  including  both 
those  with  subject  matter  orientations  and  those  who  represent 
particular  parties  in  the  educational  process.  Using  these 
groups  and  individuals  to  make  qualitative  judgments  regarding 
the  scope  and  content  of  necessary  surveys  and  tests  is  likely  to 
reduce  public  concern  with  any  seemingly  inappropriate  federal 
involvement. 

Problems    in    public    perception    of    excessive    burden  and 
C..  expense .     The  surveys  and  testing  programs  just  described  will 

inevitably  mean  new  burdens  on  educational  personnel  and  new 
public  expense.  The  burdan  and  expense  could  be  reduced  by  use 
of  smaller  samples,  although  that  strategy  will  prevent  local 
educational  agencies  and  smaller  state  agencies  from  obtaining 
information  on  their  educational  programs.  The  ideal  arrangement 
would  be  for  states  and  local  sducational  agencies  to  find  the 
data  potentially  available  from  these  surveys  and  tests  so  desir- 
able that  they  will  use  their  own  resources  to  pay  for  them  just 
as  states  are  currently  able  to  contract  for  National  Assessment 
for  Educational  Progress  (NAEP)  results  on  a  statewide  basis. 
Ultimately,  however,  NCES  and  ED  will  simply  have  to  trade  off 
the  benefits  of  these  survey  and  test  activities  against  the 
Center's  other  investments. 
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Stat,  protests  provoked  by  the  Secretary's   -Well  Ch.rt."  a.t. 
generated  as  a  result  of  the  proposed  surveys  and  tests  will  only 
be  able  to  describe  a  part  c<  the  educational  program  of  a  parti- 
cular agency.     By  omitting  .uch  Important  variables  .s  student 
characteristics,  parent  and  community  preferences,  .nd  financial 
resources  available  for  education,   the  new  data  could  generate 
misleading  comparisons.     Analysis  of  the  new  data  will  thus  need 
to    consider    other,    noneurrlculum    factor,    in    order    to  avoid 
erroneous  conclusions. 

.,.K,.».    Of    enr-.r--''n.    diver->   educational   goals.  »o 
matter  how  broad  the  participation  in  the  developmental  process, 
the  surveys   and   test,  cannot  encompass  all  of  the  objectives, 
content,   and  -ethod.  that  .re  used  In  African  elementary  and  r 
..cond.      education.     Because  they  cannot  possibly  be  perfectly 
comprehensive,    educational   agencies   whose   program,   -fit"  the 
survey  structure  will  obtain  more  accurate  and  useful  Information 
than  will  .9."cl..  'or  -.Ich  the  fit  1.  poorer.     This  problem 
suggest,  that  the  developmental  proces.  will  need  to  continue 
even  c't.r  full-.c.le  Implementation  1.  under  way,  in  order  to 
accommodate  .t.te  .nd  local  dlv.r.lty  .nd  to  Improve  th.  .urvey/ 
testing  fit  across  dgencles. 


Concluding  Cororoents 

Because  of   the  potentially   l.rge   scale  of   the  activities 
reguired  by  thi.  propos.l,  it  L  =l"r  th.t  NOES  could  not  launch 


454 

442 


any    p.rt    o£    it    without    .xt.nsiv.    advance    consultation  ana 
consensus-building.     An  ..tly  step  in  this  process  -ill  be  to 
identify   actors    in   the    national    educational    arena    that  have 
already    expressed    interest    in    these   types   of    data  collection 
activities  and  to  determine  what  their  particular  objectives  are. 
The  council   of   Chief   State  School  Officers   is  one   such  major 
association  and  is  in  fact  in  a  central  position  to  advance  and 
even  implement  parts  of  this  proposal.    A  second  early  step  wUl 
be  to  identify  -ays  of  limiting  th.  initial  implementation  of  the 
project,     on.  -ay  would  b.  to  confine  initial  .urvey  and  testing 
activities  to  curriculum  and  achievement  in  academic  courses  at 
the  secondary  level,  .inc.  the  need,  and  precedent,  there  seem  to 
be    clearer    than    for   elementary    schooling.      Whatever  initial 
limit,  are  adopted,  the  demand  i.  lU.ly  to  build  for  the  types 
of  information  d..erlb.d  h.r..    NCES  .hould  b.gin  no-  to  consider 
approaches  for  addressing  th.  d.mand. 
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NEEDED  RESOLVES  FOR  EDUCATIONAL  RESEARCH 

Prepared  for  the  National  Center  for  Education  Statistics 

Susan  J.  Rosenholtz 
University  of  Illinois,  Urbana-Champaign 

Since  the  report  of  the  National  Commission  on  Excellence  in  Education 
prophesized  an  omen  of  doom  for  public  education  nearly  two  years  ago, 
educational  policy-makers  in  nearly  every  state  have  scrambled  to  predict  and 
conquer  educational  events  and  practices  that  appear  most  out  of  controls 
Underlying  much  of  the  current  flurry  of  reform  activity  is  the  assumption  that 
the  teacher's  effectiveness  in  no  small  way  accounts  for  the  adequacy  of 
student  learning.    From  the  researcher's  viewpoint,  the  teacher  workforce  is 
indeed  sorely  troubled.    Shortages  of  qualified  teachers  have  already  begun  to 
appear  in  some  states  (NCES  1984).  The  intellectual  caliber  of  new  teaching 
recruits,  at  least  to  the  extent  that  it  is  revealed  by  measures  of  verbal 
ability,  is  considerably  lower  than  was  true  a  decade  ago  (Schlechty  &  Vance 
1981;  Weaver  1981).  The  ability  of  schools  to  retain  their  most  academically 
talented  teachers,  again  as  revealed  by  tests  of  verbal  ability,  is  also 
disheartening  (Lyson  4  Falk  1984;  Pavalko  1970;  Schlechty  &  Vance  1981).  And 
while  the  success  of  those  who  remain  in  teaching  wanes  considerably  after  five 
years  of  experience  (Katzman  1971;  Levin  1975;  McLaughlin  &  Marsh  1978;  Summers 
4  Wolfe  1977)  their  rates  of  retention  in  the  workforce  far  exceed  that  of 
novices  in  the  early  stages  of  their  teaching  careers  (Burlingame  1980; 
/  Charters  1970;  Pederson  1970). 

Because  of  widespread— and  largely  Justified—alarm  about  the  status  of 
our  nation's  teaching  corps,  many  states  and  localities  are  seeking  through 
various  means  to  Improve  their  teaching  forces.    These  efforts  take  many  forms: 
written  examinations  for  teachers,  extended  apprenticesnip  periods,  financial  ' 
incentives  and  rewards  for  classroom  excellence,  various  schemes  for  evaluating 
teacher  performance,  and  more.    The  plethora  of  interventions  initiated, 
however,  appear  to  rest  on  no  solid  base  of  valid  and  widely«>accepted  knowledge 
about  the  teaching  occupation.    The  many  attributes  of  effective  teachers  are 
not  well  understood.    The  sources  of  teacher  effectiveness  are  even  less  well 
known.    The  organizational  and  occupational  influences  on  teaching  excellence 
are  poorly  mapped.    The  incentives  and  rewards  that  motivate  individuals  to 
enter  the  workforce,  to  remain  teachers,  and  to  become  more  effective  teachers, 
are  the  subject  of  much  conjecture  by  policy  makers,  but  little  available 
knowledge. 

How  can  the  academically  talented  be  drawn  into  teaching?   How  can  persons 
of  ordinary  ability  be  furnished  with  training,  experiences,  occupational 
conditions,  and  rewards  that  will  make  them  more  effective  teachers?    How  can 
effective  teachers  be  retained  In  the  classroom?    These  are  but  a  few  of  the 
fundamentally  important  questions  to  which  policy  makers  need  answers  if  the 
fruits  of  their  labors  are  to  yield  a  more  abundant  harvest  in  improving  public 
education. 

To  resist  the  blandishment  of  well«*intended  but  ill-informed  social 
engineering,  to  provide  feedback  into  the  policy-making  process  so  as  to 
encourage  good  ideas,  discourage  bad  ones,  and  permit  wise  mid-course 
corrections—these  are  the  goals  that  deserve  full  attention  and  support  from 
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the  research  community.    The  gathering  of  systematic  information  about  the 
effects  of  various  policy  changes    epresents  nothing  less  than  a  rational  basis 
for  further  decision-making,  planning,  and  action.    And  with  the  wide 
variations  in  policy  changes  currently  underway  in  states  and  localities,  the 
opportunity  is  at  hand  to  qc  precisely  that. 

Although  sorely  underutilized  by  policy  makers,  in  a  research  sense  we  are 
already  mounting  a  successful  front  against  the  common  enemy  of  low  school 
productivity.    And  we  are  equipped  with  sufficient  conceptual,  analytic,  and 
methodological  clarity,  and  a  secure  enough  knowledge  base,  to  launch  further 
forays.    In  the  section  that  follows  I  provide  the  conceptual  underpinnings, 
but  by  no  means  an  exhaustive  description,  of  the  knowledge  about  effective 
school  practices  that  bear  directly  on  the  quality  of  the  teacher  wrkforce.  I 
will  look  at  the  ways  working  conditions  enhance  teacher  commitment,  retention, 
and  teaching  effectiveness  across  a  wide  range  of  studies.    Armed  with  this 
conceptual  understanding,  current  policy  decisions  and  their  ability  to  affect 
positive  changes  will  Uien  be  analyzed. 


The  Dimensions  of  Teacher  Commitment 

That  the  most  vital  resources  for  student  learning  are  the  contributions 
of  effort  and  involvement  from  teachers  is  a  proposition  few  would  dispute. 
Teacher  commitment  and  its  attendant  behaviors,  however,  are  not  categorical  or 
unvarying  commodities.    They  depend  to  no  small  extent  on  the  incentives  anc 
opportunities  offered  by  the  school  and  on  the  organizational  conditions  mdtr 
which  teachers  work.    In  particular,  teachers  are  motivated  both  to  remain 
within  a  setting  and  to  contribute  productively  only  so  long  as  the  inducements 
offered  then  are  as  great  or  greater  than  the  contributions  they  are  asked  to 
make  (Locke  1975;  March  &  Simon  1958).  In  other  words,  the  rewards  of  one's 
work  must  outweigh  the  frustrations. 

Teacher  rewards.    There  Is  limited  information  on  the  Importance  of 
monetary  rewards  in  securing  teachers'  commitment,  but  the  extant  data  provides 
little  empirical  evidence  that  increased  pecuniary  benefits  bring  about 
positive  changes  in  teachers'  performance  (Mann  1985;  McLaughlin  &  Marsh  1978), 
or  prevent  their  defection  from  the  workforce  (Bredeson,  Fruth  &  Kasten  1983; 
Bruno  1981a;  Chapman  &  Hutcheson  1982;  Frataccia  &  Bennington  1982).  Teaching 
rewards  instead  flow  directly  from  feelings  of  efficacy:  from  recognition  of 
one's  own  capacities  to  affect  student  growth  and  development  (dishop  1977; 
Bredeson,  Fruth  &  Kasten  1983;  Glenn  &  McLean  1981;  Lortie  1975;  McLaughlin  & 
Marsh  1978). 

Teachers'  inability  to  accrue  psychic  dividends  from  their  work  luay 
manifest  itself  most  dramatically  in  a  decision  to  defect  from  the  workforce 
(Bredeson  et  al.    1983;  Chapman  1984;  Chapman  &  Hutcheson  1982;  Litt  &  Turk 
1983;  Rosenholtz  et  al.    1985).  The  link  between  dissatisfaction  and  actual 
defection,  however,  may  be  mediated  by  the  alternatives  individuals  perceive  to 
be  available  (Locke  1975;  March  *  Simon  1958).  A  lack  of  alternative  types  of 
employment,  for  example,  may  cause  dissatisfied  teachers  to  stay  where  they  are 
and  simply  withhold  service.    Although  the  particular  manifestations  of 
withheld  service  are  not  fully  known,  there  is  evidence  that  workers  sometimes 
absent  themselves  to  provide  temporary  relief  from  unsatisfactory  Job 
conditions  (Johns  &  Nicholson  1982).  Indeed,  teacher  absenteeism  is 
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particularly  prevalent  in  ineffective  low  SEo  schools  (Bruno  198lb;  Bruno  & 
Doscher  1981;  Spuck  1974),  where  large  discrepencies  sometimes  exist  between 
the  inducements  of  teachers*  work,  and  the  contributions  they  are  expected  to 
make. 

Teacher  certainty.    In  addition  to  psychic  inducements,  productive 
involvement  In  work  also  requires  challenge  (Locke  1975).  Challenge  stimulates 
involvement  by  requiring  that  individuals  exercise  Judgement  and  choice;  in 
doing  so^  they  become  the  main  causal  agents  in  performance.    Further,  coping 
with  challenge  requires  the  expenditure  of  effort.    If  this  expenditure 
produces  some  improvement  in  performance,  commitment  is  enhanced.  Individuals 
move  initially  toward  confronting  challenge,  however,  only  when  there  is  a 
reasonable  chance  of  success — some  assurance  that  their  efforts  will  produce 
desired  outcomes  (Campbell  &  Pritchard  1975).  In  the  case  of  teachers, 
commltm  nt  to  meet  classroom  challenges  pivots  fundamentally  upon  their 
certalnw  about  professional  practices—a  belief  in  their  ability  to  help 
students  grow  and  develop  (Azuml  &  Madhere  1983;  Glldewell  et  al.  1983; 
McLaughlin  &  Marsh  1978;  Rosenholtz  et  al,    1985).  When  certainty  pertains,  it 
defines  and  organizes  teacher  action  to  facilitate  student  learning  (Armor  et 
al.    1976;  Ashton  et  al.    1983;  Brookover  et  al.    1979;  McLaughlin  &  Marsh 
1978).  The  other  side  of  the  same  coin  is  that  challenges  perceived  as  too 
great  or  costly  may  cause  individuals  to  experience  a  sense  of  failure  and 
frustration,  leading  often  to  inaction  (Locke  1975).  In  other  words,  teachers 
who  are  uncertain  about  their  capacity  to  affect  student  learning  tend  not  to 
act  in  ways  that  will  bring  learning  about*    One  need  only  consult  the  plethora 
of  research  on  differential  teacher  expectations  to  see  how  powerful  this 
self-fulfulllng  prophecy  can  be  (for  a  ^^eview,  see  Hawley  &  Rosenholtz  1984). 
Because  the  products  of  uncertalnty-*e.g.    low  student  learning  and  teachers* 
sense  of  failure—ultimately  diminish  teaching  rewards,  it  Is  /lOt  surprising 
that  teachers  who  lack  confidence  in  their  professional  skills  tend  to  show 
higher  rates  of  absenteeian  and  defection  from  the  workforce  (Chapman  1984; 
Chapman  &  Hutcheson  1982;  Litt  &  Turk  1983). 

Skill  development.    To  secure  individuals'  commitment,  the  woric  setting 
must  not  only  provide  challenges,  it  must  also  provide  crportunltles  to  deal 
successfully  with  them  (Locke  1975) •  It  follows  therefore,  that  opportunities 
for  skill  acquisition  and  development  that  enhance  teachers'  capabilities  are 
heavily  Implicated  in  their  commitment*    While  there  is  a  dearth  of  research  on 
this  assertion,  the  slgnlflcanoe  of  skill  development  for  disaffection  seems 
logical  enough;  limited  opportunities  for  professional  growth  Impair  teachers' 
certainty  about  instructional  practice,  their  effectiveness,  their  acquisition 
of  intrinsic  rewards,  and  ultimately  their  commitment  to  the  school  and 
profession  (see,  for  example,  Huberman  &  Miles  1984;  Rosenholtz  et  al,  1985)* 
Not  unexpectedly,  the  absence  of  opportunities  for  professional  growth  is 
frequently  cited  by  teachers  as  a  reason  for  disaffection  and  attrition 
(Bredeson  et  al.    1983;  Mann  1985;  Rosenholtz  et  al.  1985). 

The  three  intervening  variables  affecting  commitment — teacher  certainty, 
skill  acquisition,  and  rewards-*-rely  heavily  on  the  actions  of  others  within 
the  school— ^colleagues  and  principal--and  are  thus  strongly  influenced  by 
specific  organizational  policies  and  practices.    I  turn  next  to  a  description 
of  these  additional  factors. 
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Organizational  Determinants  of  Teacher  Commitment 

Teacher  evaluation^    Skill  acquisition,  certainty,  and  rewards  depend  to 
no  small  extent  on  feedback  about  one's  performance — for  teachers,  on  evidence 
of  student  growth  and  learning.    Yet  teachers  frequently  indicate  difficulty  in 
knowing  precisely  how  well  they  are  doing  (As'hton  et  al.    1983;  Glidewell  et 
al.    1983;  Lortie  1975),  leaving  many  uncertain,  unrewarded,  and  without  the 
specific  information  needed  to  redirect  their  energies  toward  improvement. 
Ambiguity  about  the  nature  of  one's  performance  springs  at  least  in  part  from 
an  absence  of  both  clear  goals  around  which  to  mobilize  teaching  efforts,  and 
clear  criteria  by  which  teacher  performance  is  monitored  and  evaluated. 

V/hile  many  school  administrators  muster  little  effort  to  resolve  this 
ambiguity  for  teachers,  those  in  the  most  effective  schools  develop  clear  goals 
and  ubiquitously  monitor  classroom  efforts  toward  their  pursuit  (Glenn  4  McLean 
1981;  Hort,  Steigelbauer  &  Hall  1984;  Natriello  1984;  Natriello  4  Dornbusch 
1980;  Sizemore  et  al.    1983;  Venezky  4  Winfield  1979).  With  clear,  useful,  and 
frequent  evaluation,  teachers  can  work  directly  to  improve  performance;  as 
performance  Improves,  there  is  greater  certainty  about  instructional  practice, 
and  with  it  renewed  ieacher  effort  and  larger  psychic  dividends  (Rosenholtz  et 
al.    1985).  It  is  not  surprising,  therefore,  that  teachers  report  greater 
satisfaction  and  commitment  where  principals  provide  frequent  and  clear 
evaluation  (Azurai  4  Madhere  1983;  Chapman  4  Lowther  1982;  Natriello  1984; 
Natriello  4  Dornbusch  1980;  Rosenholtz  et  al.  1985). 

Buffering.  Greater  commitment  is  also  secured  by  working  conditions  that  ( 
facilitate  individualsV  attainment  of  work  goals  (Locke  1975),  for  teachers,  on 
conditions  that  optimize  the  possibility  of  student  learning.  Intrusive 
managerial  tasks  that  pull  teachers  aw >/  from  instruction  are  frequently 
culpable  in  the  absence  of  their  skill  acquisition,  certainty,  rewards,  and 
commitment  (Bredeson  et  al.    1983;  Lortie  1975;  Raschke,  Dedrick,  Strathe,  4 
Hawkes  1985;  Rosenholtz  et  al.  1985). 

Efficacious  principals  (or  their  administrative  cadre),  themselves  certain 
of  the  relationship  between  teacher  effort  and  student  learning,  work  to 
"buffer"  teachers  from  unnecessary  intrusions  that  distract  them  from  the 
Sc/Stance  of  their  work.    Buffering  activities  include  attending  to  th'^ 
material  requirements  and  organization  of  instructional  programs,  providing 
clerical  assistance  or  outside  resources  for  routine,  non-teaching  tasks,  and 
protecting  classroom  learning  time  from  interruptions  such  as  loud  speaker 
announcements  and  other  low  priority  matters  (Armor  et  al.    1976;  Glenn  4 
McLean  1981;  Hort  et  al.    1984;  Rutter  et  al.    1979;  Venezky  4  Winfield  1979). 

Managing  student  behaviur.    Effective  administrators  also  distinguish 
themselves  from  their  ineffective  counterparts  by  setting  and  enforcing  clear 
expectations  for  student  behavior  (Brookover  et  al.    1979;  Glenn  4  McLean  1981; 
Rutter  et  al.    1979).  A  climate  of  disorder  does  more  than  frustrate  teachers; 
when  teachers  attend  constantly  to  mediating  classroom  disputes,  the>  do  so  at 
the  expense  of  the'r  students*  learning  time,  their  own  instructional 
improvement,  their  confidence  about  teaching  skills,  and  any  psychic  rewards 
that  follow  (Raschke  et  al.    1985;  Rosenholtz  et  al.    1985).  This  explains  why 
teachers  often  cite  student  misbehavior  as  a  cause  for  dissaffection  and 
attrition  from  the  workforce  (Bredeson  et  al.    1983;  Buschke  et  al.  1985; 
Rosenholtz  et  al.    1985).  And  since  learning  to  manage  student  behavior  is  the 
first  important  task  of  the  teaching  neophyte«**and  one  that  is  used  as  an 


ERLC 


460 

443 


initial  measure  of  their  potential  (Hoy  1969;  McArthur  1979;  Warren  1975) — it 
is  not  surprising  that  attrition  is  highest  in  these  early  years  of  teaching. 

Teacher  Isolation,    Most  schools  are  characterized  by  isolated  working 
conditions,  where  colleagues  seldom  see  each  other  teach  (Bishop  1977;  Cohen 
1981;  Lortie  1975).  Under  these  conditions  norms  of  autonomy  develop,  where  the 
responsibility  for  classroom  success  resides  solely  with  individual  teachers 
(Bishop  1977;  Glidewell  et  al.    1983;  Lortie  1975).  Requests  for  and  offers  of 
assistance  among  faculty  are  believed  to  carry  status  information  about 
relative  teaching  competence:  teachers  tend  not  to  request  assistance  for  fear 
of  appearing  incompetent;  teachers  tend  not  to  offer  assistance  for  fear  of 
implying  incompetence  (Glidewell  et  al.    1983;  Lortie  1975).  Vte  know  little 
about  how  such  faculty  norms  develop,  but  it  is  reasonable  to  suppose  that  the 
primarily  social  conversations  that  characterize  teachers'  interactions  in 
isolated  settings  (Bishop  1977;  Glidewell  et  al.    1983i  Little  1982)  occur  in 
an  effort  to  avoid  these  status  implications. 

Professional  isolation  has  a  profound  effect  on  teachers*  skill 
acquisition,  certainty,  and  intrinsic  rewards.    For  one  thing,  their  capacity 
for  growth  is  limited  in  isolated  settings  by  their  own  ability  to  diagnose 
problems,  develop  solutions,  and  evaluate  their  effectiveness  (Lortie  1975). 
With  little  access  to  role  models  among  their  peers  (Gehrke  &  Kay  1984;-Lortie 
1975)»  they  realize  little  benefit  from  their  more  experienced  and  expert 
colleagues.    Similarly,  the  intrinsic  rewards  to  be  derived  from  colleagues* 
positive  evaluations  of  one's  skills  and  ideas  are  foregone  in  isolated 
settings  (Rosenholtz  et  al.  1985). 

Faculty  collaboration.    Not  all  schools  are  isolated  workplaces;  in  the 
more  collaborative  settings  of  effective  schools,  teachers  come  to  believe  that 
teaching  is  a  collective  rather  than  an  individual  enterprise.  Professional 
dialogue  among  colleagues  in  these  schools  is  frequent,  and  analysis, 
evaluation  and  experimentation  with  colleagues  set  the  conditions  under  which 
teachers  Improve  instructionally  (Armor  et  al.    1976;  Little  1982;  Mann  1985; 
Rutter  et  al.    1979;  Venezky  &  Winfield  1979).  In  collaborative  settings, 
teachers  Interact  more  about  professional  than  social  matters,  and  interact 
with  a  greater  number  of  colleagues  than  is  true  in  more  isolated  settings 
(Bishop  1977;  Bridges  4  Hallinan  1978;  Glidewell  et  al.    1983;  Uttle  1982). 
Ideas  that  are  the  product  of  collaborative  exchange  appear  to  give  rise  to 
greater  experimentation  in  classrooms,  and  g  water  teacher  learning  and 
certainty,  as  better  solutions  to  teaching  problems  are  found  (Rosenholtz  et 
al.    1985).  And  it  is  precisely  these  conditions  that  most  clearly  explain  why 
teacher  absenteelan  and  defection  are  substantially  lower  in  collaborative  than 
in  isolated  settings  (Bridges  &  Hallinan  1978;  Litt  &  Turk  1983;  Rosenholtz  et 
al.,  1985;  Sizemore  et  al.    1983;  Venezky  &  Winfield  1979). 

We  know  therefore,  that  informal  learning  experiences  can  and  do  influence 
teaching  knowledge.    Strikingly  absent  for  the  literature,  however,  are  studies 
that  look  at  the  combination  of  formal  and  informal  mechanisms  that  shape 
teachers'  beliefs  about  the  definition  of  "what  good  teaching  is,"  that 
accentuate  or  enhance  the  acquisition  of  skills,  that  define  the  standards  by 
which  teachers  measure  their  success  I'j  teaching,  and  that  therefore  signal  the 
need  to  develop  new  teaching  skills  oi  perfect  old  ones. 

Participation  in  Decision^Making.  One  informal  raechanisn  that  may  account 
for  collaborative  exchange  among  faculty  in  efficacious  schools  is  teachers' 
participation  in  decision-making  about  matters  related  to  teaching,  e.g.. 


Er|c  461 


selecting  instructional  materials  and  methods  (Armor  et  al.    1976;  Glenn  & 
McLean  1981;  Rosenholtz  et  al.    1985;  Rutter  et  al.    1979).  The  contribution  of 
decision-making  to  teachers'  skill  acquisition  and  certainty  lies  in  the 
deliberative,  evaluation,  discussion,  suggestion,  and  modificai*^'  n  of 
instruction  required  to  enhance  the  quality  of  classroom  Ip-       4.  These 
activities  themselves  may  lead  to  increased  teacher  clarity  aDuut  instructional 
purpose,  and  ultimately,  to  greater  effectiveness,  as  decisions  become 
conscious  and  well-reasoned  choices  rather  than  arbitrary  or  automatic 
reactions  (e.g.  Cruickshank  1985;  Mann  1985). 

In  addition  to  its  effects  on  skill  acquisition,  certainty,  and  intrinsic 
rewards,  participation  in  decision-making  may  directly  augment  commitment 
through  an  increased  sense  of  school  ownership  as  teachers  identify  their  own 
important  contributions  to  a  valued  collective  enterprise.    The  point  here,  of 
course,  is  that  teachers  who  do  not  subscribe  to  the  faculty's  purpose  are  not 
likely  to  contribute  their  full  efforts.    This  explains  most  clearly  why  the 
absence  of  teachers'  involvement  in  decision-making  is  positively  related  to 
their  absenseeiam  and  defection  (Azumi  &  Madhere  1983;  Chapman  &  Hutcheson 
1982;  Rosenholtz  et  al.  1985). 

Organizational  rigidity  and  flexibility.    Another  informal  mechanism  that 
is  implied  by  norms  of  collaboration  and  decision-making  is  the  organizational 
flexibility  necessary  to  alter  instructional  programs  to  meet  specific 
classroom  needs.    However,  uncertainty  about  the  ability  of  teachers  to  help 
students  learn  may  sometii  js  lead  principals  to  apply  excessive  pressure  for 
conformity  to  rules  and  regulations  lAich  may  themselves  be  overly  specifiCa 
Insistence  on  ritualistic  adherence  to  school  procedures  not  only  leads 
directly  to  profound  teacher  disaffection  (Hoy,  Tarter  4  Forsyth  1978),  it  also 
produces  greater  feelings  of  power lessness  and  uncertainty  (Cox  &  Woods  1980) 
and  diminished  focus  on  learning  goals  (Willower  &  Jones  1963).  In  the  end 
then,  organizational  rigidity  reduces  teachers*  ownership  of  instructional 
programs  and  pays  few  dividends  in  teachers'  skill  development,  psychic 
rewards,  or  commitment  (Raschke  et  al.    1985;  Rosenholtz  et  al.  1985)* 

Education  Reform 

In  the  preceedlng  discussion  I  have  emphasized  the  Importance  of  workplace 
conditions  in  helping  teachers  develop,  perfect  and  add  to  their  fund  of 
teaching  skills  ttiroughout  their  professional  lives.    This  conceptual 
understanding  provides  a  framework  to  gauge  the  educational  efficacy  of  many 
reform  proposals  that  have  gained  considerable  currency  among  policy-makers. 
The  central  question  in  all  discussions  of  school  reform  is,  of  course,  the 
extent  to  which  changes  will  Improve  the  quality  of  Instructional  services  that 
schools  deliver.    How  can  schools  be  restructed  ir  ways  that  permit  teachers  to 
use  their  talents  most  productively  in  helping  themselves  and  others  to  improve 
instruction?    How  will  new  standards  for  student  learning  affect  what  teachers 
actually  emphasize  in  their  classrooms?    How  will  the  performance  recognition 
and  status  elevation  of  more  talented  teachers  as  proposed  in  various  career 
ladders  plans  affect  both  their  motivation  and  commitment  as  well  as  that  of 
others?    Under  what  conditions  are  these  innovati^^ns  most  likely  to  succeed? 

While  any  number  of  reform  efforts  might  be  juxtaposed  against  our 
cumulative  knoweledge,  I  examine  the  effects  of  two  specific 
proposals~standards  for  student  learning  and  career  ladders-^'-to  illustrate  the 
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rather  straightforward  proposition  that  through  careful  research  and  analysis, 
sound  information  about  intervention  strategies  supplied  to  policy  makers  will 
enable  them  to  make  sense  out  of  the  many  events  that  are  occuring  so  that  they 
can  be  helped  to  foster  and  support  further  school  improvement. 

While  any  school  intervention  can  be  developed,  funded,  supported  and 
delivered  to  schools  to  help  them  improve,  the  ultimate  measure  of  their 
success  depends  to  no  small  extent  x>n  how  the  intervention  is  executed.  In 
this  the  teacher  is  crucial.    How  teachers  perceive  and  experience  policy 
changes  will  affect  their  commitment  to  them  and  the  extent  to  which  "le  policy 
change  will  have  a  salutary  effect  on  student  learning.    To  explore  teachers' 
perceptions,  I  turn  to  data  frc^  our  ongoing  study  of  the  organizational 
conditions  of  teaching  (Rosenholtz,  Bassler  &  Hoover-Dempsey  1985)  conducted  in 
a  Southeastern  state  where  a  career  ladder  plan  (CLP)  and  minimum  competency 
testing  (MCT)  are  currently  under  implementation.    Data  from  extensive 
interviews  we  have  conducted  with  73  randomly  selected  elementary  teachers 
statewide  will  illuminate  many  of  the  issues  I  raise,    I  will  also  draw  upon 
contemporaneous  work  by  others  who  seek  to  chronicle  and  understand  'he  effects 
of  reform  efforts  underway  elsewhere  in  the  nation. 


STANDARDS  FOR  STUDENT  LEARNING 

Some  states  have  begun  to  recognize  past  inadequacies  in  the  way  student 
performance  is  monitored,  and  attempts  are  now  underway  to  institute 
appropriate  changes.    One  such  strategy  sets  skill-specific  standards  and 
learning  sequences  that  all  teachers  must  cover  in  their  classroom  curriculum. 
Conformity  to  new  standards  is  monitored  through  the  periodic  and  frequent 
testing  of  students. 


The  Importance  of  Standards 

Of  fundamental  importance  to  any  policy  study  of  educational  reform  is  the 
definition  of  student  learning  itself.    In  isolated  settings,  teachers*  and 
administrators*  perceptions  of  student  learning  are  highly  individualistic, 
since  they  are  based  on  those  classroom  activities  and  student  behaviors  that 
each  considers  Important.    They  may  include  students*  problem  solving  skills, 
peace  and  quiet  in  the  corridors  and  classrooms;  the  development  of  youngsters* 
self-concept;  children*s  basic  skill  acquisition;  the  inculcation  of  racial 
tolerance  and  friendly  interpersonal  behavior,  and  so  on. 

Yet  the  literature  on  effective  schools  apprises  us  of  the  importance  of 
shared  organizational  goals  (Rosenholtz  1985a),  Where  there  are  particular 
goals  for  students*  basic  skill  acquisition,  agreement  among  teachers  and 
administrators  as  to  their  importance,  and  collaboration  about  the  means  by 
which  to  implement  them,  there  is  an  organizational  basis  for  directing  teacher 
behavior,  for  motivating  teacher  behavior,  and  for  evaluating  teacher 
behavior.    Goals,  then,  can  be  useful  in  mobilizing  the  efforts  of  school 
personnel  by  providing  specific  targets  and  directions  for  change. 

In  the  southeastern  state  we  have  been  studying,  the  department  of 
education  established  MCT  for  elementary  grade  students,  by  identifying  1,300 
skills  in  reading  and  nath,  of  which  680  must  be  learned.    The  interviews  we 
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conducted  with  teachers  two  years  after  implementation  revealed  uniformly  high 
conformity  to  the  guidelines  as  well  as  accompanying  changes  in  teachers' 
instructional  emphases. 

Twenty-two  percent  of  the  teachers  interviewed  found  the  guidelines 
helpful  in  detecting  students'  learning  difficulty,  and,  of  far  greater 
significance, •  in  changing  the  way  learning  is  perceived  by  both  students  and 
teachers.    As  one  explained,  "I  find  skills  that  children  don't  have  and  so  I 
have  to  teach  them.    Now  teachers  care  that  students  learn.    Before  they  could 
Just  teach  and  if  the  students  learned,  okay;  if  not,  they  could  just  go  on  to 
the  next  thing.    The  kids  also  know  that  'I  have  to  know  this'  and  'my  teacher 
cares  that  I  get  it.'    So  it  helps."    Others  concurred  with  the  meliorative 
effects  of  MCT  on  poorer  teachers,  e.g.    "I  think  the  standards  are  more 
effective  for  teachers  who  need  guidelines."    In  fact  some  teachers  hailed  the 
change  as  a  way  to  orient  their  own  classroom  instruction,  thereby  ensuring 
that  the  most  important  skills  receive  adequate  time  and  attention:  "I  think  it 
helps  a  teacher  measure  her  own  teaching.    Lots  of  times  I  will  compare  my 
tests  with  their  [the  state's]  guidelines.    Now  I'm  more  aware  of  some  specific 
skills  and  how  well  I  have  taught  them  as  well  as  how  well  they're  covered  in 
the  curriculum."    Darling-Hammond  and  Wise  (1985),  in  their  study  of  evaluation 
practices  in  two  middle-Atlantic  states,  also  found  that  a  minority  of  teachers 
regarded  MCP  as  a  good  management  tool  for  helping  less  competent  teachers  to 
do  their  Jobs,  and  for  ensuring  that  a  specific  body  of  knowledge  was  covered 
in  the  classroom  curriculum. 

A  critical  factor  in  the  study  of  state  level  intervention,  then,  at  least 
at  the  elementary  school  level,  is  the  extent  to  which  standards  alter  the 
goals  that  teachers'  set  for  themselves,  what  they  come  to  emphasize  in  their 
classroom  curricula,  and  how  their  teaching  effectiveness  is  gauged.    That  is, 
where  standards  for  student  evaluation  are  clearly  specified,  and  where 
teachers  may  also  be  Judged  by  their  students'  abilities  to  reach  these 
standards,  instructional  content  may  become  driven  by  newly  Implemented 
standards  and  their  measurement.    Anecdotal  evidence  suggests  that  this  may  be 
already  occur ing  in  Texas,  Detroit,  South  Carolina;  and  Maryland  (Popham, 
Cruse,  Rankin,  Sindifer,  &  Williams  1985). 

Unintended  Consequences  of  MCT 

Organizational  rigidity.    MCT,  however,  was  not  uniformly  welcomed  by  all 
teachers,  and  there  were  some  unintended  and  negative  consequences  in  its 
implementation.    One  concern,  voiced  as  well  by  teachers  in  the  Darling-Hammond 
and  Wise  (1985)  sample,  was  that  rigid  standards  impaired  teachers'  discretion 
to  match  appropriate  learning  objectives  to  particular  student  needs.    Over  one 
third  of  our  sample  expressed  this  objection,  e.g.,  "All  kids  are  to  be  exposed 
to  all  skills.    I  don't  think  that  does  any  good.    If  you  progress  too  fast, 
the  kids  still  lose  out.    The  kids  have  to  learn  the  basics  first,  or  it  won't 
do  any  good  to  expose  them  to  other  skills";  "Sometimes  I  give  tests  at 
different  times  than  I*m  supposed  to.    I'll  teach  the  skills  first,  and  then 
give  .he  test,  regardless  of  when  they  say  I'm  supposed  to  give  the  test.  It 
doesn't  make  much  sense  to  test  kids  on  stuff  they  haven't  studied";  "It  used 
to  be  that  we  would  take  up  where  the  kids  were  and  you  would  go  as  far  as  you 
could  with  them.    Now  they  say  we  are  not  to  do  that  anymore";  "The  business  of 
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all  second  grade  teachers  teaching  the  same  across  the  state,  being  on  the  same 
unit,  the  same  page,  is  the  most  absurd  thing  I  have  ever  heard  in  my  life.  We 
are  all  supposed  to  be  teaching  the  same  thing  at  the  same  time  so  if  a  child 
transfers  from  one  school  or  system  across  the  state,  they  won't  be  behind"; 
"There  are  too  many  skills  to  get  through  when  some  children  can't  even 
regroup.    Because  children  are  different  you  have  to  make  allowances  for  them"; 
"With  the  Basic  Skills  Program  everyday  I  feel  more  frantic.    I  feel  like  a 
cattle-driver  with  a  whip:  like  we  have  to  get  through  the  pass  before 
nightfall." 

In  the  implementation  of  MCT,  then,  teachers  confront  a  dilemma  between 
the  coverage  of  required  basic  skills  on  the  one  hand,  and  rudimentary  mastery 
of  them,  on  the  other.    Thus  a  critical  question  in  the  study  of  MCT  is  the 
extent  to  which  it  allows  for  local  variations  within  students'  skill  levels, 
and  local  deviations  from  statewide  norms.    To  inhibit  the  appropriate  pacing 
of  instruction  to  accomodate  different  learning  needs  or  to  prevent  the 
adaptation  of  curricular  content  to  improve  its  fit  to  those  needs,  is  to 
unwittingly  program  students  and  teachers  for  greater  academic  failure. 

Another  quarter  of  the  teachers  in  our  sample  complained  that  curricular 
areas  other  than  reading  and  math  were  being  short-^changed  by  state  standards. 
Even  kindergarten  teachers  lamented  these  effects:  "I  am  not  able  to  do  things 
that  are  good  for  kindergarteners.    I  feel  like  I  have  to  hide  in  my  room  to 
let  children  have  show-and-tell";  "I  wanted  to  do  more  creative  dramatics  and 
storytelling  [this  year].    I  wanted  to  expand  my  study  of  marijuana  that  I 
instituted  last  year.    Maybe  draw  in  some  teenagers  to  talk  with  the  class. 
But  there  is  not  a  lot  of  time  to  do  anything  like  that.    I  did  the  drug  unit 
during  health  but  I  had  to  steal  time  for  the  dramatics,"    Darling-Hammond  and 
Wise  (1985)  also  found  that  the  need  to  ensure  that  their  students  pass 
competency  tests  caused  teachers'  to  de-emphasize  other  Important  aspects  of 
the  curriculum. 

Lest  readers  doubt  the  value  of  alternate  learning  opportunities,  they 
need  only  consider  the  effects  of  MCT  on  language  arts  curricula  alone. 
Writing  instruction  and  i»"actlce  in  some  classrooms  have  been  replaced  by  rote 
exercises  in  sentence  diagramming  (S»Jhor  1985),  an  ineffective  instructional 
strategy  in  helping  students  better  their  writing  skills  (Sherwin  1969),  but 
nonetheless  content  most  likely  to  appear  on  competency  tests  (Suhor  1985).  It 
Is  indeed  an  unfortunate  side  effect  if  students'  opportunities  to  master  a 
broad  base  of  knowledge  are  undermined  because  teachers  divert  their 
instructional  emphases  either  to  material  that  is  to  be  tested,  or,  worse 
still,  to  the  teaching  of  test-taking  skills  themselves.    This  latter  charge 
was  alleged  by  Los  Angeles  school  board  member  and  teacher  Jackie  Goldberg: 
"Teachers  who  used  to  spend  time  reading  to  children  so  they  will  love 
literature  will  now  have  them  bubbling  in  dots  [filling  in  computer  cards]  of 
how  basesballs  are  stitched  because  this  is  one  of  the  questions  on  the 
standardized  tests."    (Chicago  Tribune,  June  2,  1985,  p.  13)* 

A  third  of  the  teachers  we  interviewed  balked  at  the  standardization 
demanded  by  the  MCT  which  in  their  view  destroyed  teacher  creativity  and 
spontaneous  teaching,  e.g.,  "Teaching  has  become  more  mechanical;  [the  MCT] 
took  away  creativity  and  the  teacher's  individuality";  "The  system  has  become 
very  dictatorial.    I  mean  I  ask  myself  all  the  time,  'I  wonder  where  all  the 
creative  teachers  will  be  in  ten  years'";  "Twenty  years  ago  they  would  say  to 
me,  'As  long  as  you  get  the  skills  taught,  do  it  your  own  way.'    We  are  as 
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individual  as  the  children  are.    And  what  works  for  my  next  door  neighbor 
doesn't  work  for  me.    It's  amounting  to  having  all  teachers  teach  the  same 
way  • " 

The  absence  of  buffering.    By  far  and  away,  the  roost  onerous  aspect  of  MCT 
to  three-quarters  of  the  teachers  in  our  sample  was  both  the  overwhelming 
burden  of  additional  paperwork,  and  the  classroom  time  required  to  test.  Over 
both  these  points  there  was  nearly  unanimous  accord-^.g. ,  "You  have  to  assess 
and  reassess  each  child,  you  have  to  pre-  and  post-test  each  child,    I  want  to 
keep  good  records;  I  always  have  kept  good  records,  but  things  are  Just  getting 
out  of  hand."    A  kindergarten  teacher  complained,  "Each  student  has  to  take  20 
to  30  tests.    It  seems  to  be  that  basic  skills  is  more  testing  than  teaching. 
That  is  all  I  do.    Each  test  takes  about  15  minutes  per  child.    I  have  to  give 
the  tests  to  each  child  one  at  a  time.    There  just  doesn't  seem  to  be  any 
benefit  in  the  program."    Indeed,  teachers  we  interviewed  reported  that 
valuable  instructional  time~the  teacher's  most  prized  resource — was 
considerably  diminished  by  paperwork  and  testing  demands — e.g.,  "I  am  actually 
teaching  less";  "There  is  too  mach  testing  rather  than  teaching";  "I'm  just  not 
sure  the  kids  are  learning  basic  skills";  "It  takes  away  from  actual  time  spent 
working  with  children";  "There's  not  much  teacher  time  to  be  human  towsrds  the 
students".    Teachers  chronicled  for  us  precisely  how  they  accomodated  new 
paperwork  demands  by  reducing  their  instructional  time  with  students:  "I  really 
feel  bad  because  I'll  let  the  kids  have  five  extra  minutes  of  play  or  give  them 
independent  seatwork  so  I  can  get  some  of  my  viork  done.    I  feel  bad  about 
taking  time  away  from  my  students,  but  I  have  to." 

VAiere  daily  planning  had  once  occupied  teachers'  after  school  hours, 
record  keeping  now  takes  its  place.    Where  teachers  once  interacted  before 
school  hours,  myriad  state  forms  now  compete  successfully  for  their  attention. 
Again  typical  of  their  sentiments  are  these  teachers'  comments,  "With  the 
paperwork,  many  teachers  stay  until  seven  or  eight  p.m.    But  if  you  have  a 
family,  you  can't  do  that.    What  I  want  to  know  is,  when  are  we  supposed  to 
teach?".    "I  feel  like  I'm  robbing  Peter  to  pay  Paul.  The  time  has  to  come  out 
of  somewhere,  doesn't  it?    I  can't  not  sleep  each  night  because  I  have  to  do 
paperwork  for  the  state.    So  I  have  to  take  it  out  of  ny  teaching  time." 
Rather  than  giving  students  greater  opportunity  to  learn  basic  skills,  and 
testing  them  to  ensure  mastery,  MCT  may  instead  rob  them  of  access  to  their 
most  critical  learning  resource-- teachers'  Instructional  time.  Indeed, 
Darling-41ammond  and  Wise  (1985).  report  identical  concerns  Issued  by  teachers 
they  interviewed.    Most  revealingly,  teachers  in  our  sample  that  found  benefit 
in  MCT  reported  being  adequately  buffered  from  the  additional  paperwork  and 
testing  demands  by  outside  Uerlcal  assistance  from  either  paid  aides  (provided 
by  the  district)  or  parent  voluteers  (coordinated  by  the  building  principal). 
For  these  teachers,  then,  MCT  provided  the  intended  and  welcomed  feedback  about 
student  progress  that  could  serve  to  redirect  their  own  teaching  strategies. 

Lowered  teacher  commitment.    Implementation  of  MCT  in  the  majority  of 
schools  may  ironically  also  cause  teachers  to  feel  professionally  violated: 
"The  amount  of  paperwork  takes  all  the  fun  out  of  teaching.    What  really 
bothers  me  is  that  the  teachers'  Judgement  is  not  considered  important  any 
longer.    Wfe  used  to  be  able  to  decide  things... Now  we  teachers  are  tYustrated. 
Every  new  program  puts  new  burdens  on  us.    Every  new  program  means  less  time  to 
do  work  with  actual  teaching  and  being  with  the  kids.    We  dislike  that  ^  lot." 
Teachers  perceived  that  new  policies  have  been  enacted  with  little 
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understanding  of  teaching  realities,  e.g.,  "I  can't  stand  it  when  th^y  make 
decisions  about  what  I'm  supposed  to  be  doing  when  they  don't  understand  what 
teaching  Is  all  about."    And  this:  "For  someone  else  to  tell  me  what  they  think 
Is  needed  when  I  can  see  some  other  things  that  a  "5  needed  myself  Is 
infuriating." 

Twenty  percent  of  our  sample  either  openly  contemplated  leaving  thfr 
profession,  or  reported  others  were  doing  so,  because  of  the  Increased  testing 
and  paperwork  demands  and  their  inability  to  derive  psychic  benefits  because  of 
l.ti  "I  have  enjoyed  teaching  but  I  am  planning  to  retire  early  because  I  have 
been  frustrated  In       ability  to  do  what  I  know  Is  best  in  my  ow  classroom.  I 
think  that  with  the  amount  of  paperwork  that  we  have,  the  recjralng  and  testing 
and  everything,  that  I'll  leave  that  to  someone  younger."    "I  am  really  afraid 
that  all  the  30od  teachers  are  going  out  of  teaching.    Sometimes  I  ask  myself, 
'Will  we  only  have  desk-sitters  In  the  future?'" 

Over  sixty  percent  of  our  sample  of  teachers  complained  of  lower  morale  on 
their  facultlv»s  brought  about  !^y  MCT:  "Everyone  feels  bad  about  being  a  teacher 
these  days.    Everytlme  you  turn  around  It  seems  there's  always  someone  telling 
Y^u  that  you're  doing  a  lousy  job.    I've  stopped  reading  the  newspaper  at  ^11 
because  if  they  sa/  something  negative  about  teachers  It  doesn't  make  me  want 
to  go  to  work  that  day...    All  we  [the  faculty]  seem  to  do  these  days  is 
complain.    Vfe  all  feel  It.    I  don't  think  the  public  realizes  hew  hard  It  Is  to 
do  a  good  Job— -to  work  through  teaching  problems— when  everyone* *i  saying  you 
can*t." 

"I  think  the  morale  of  teachers  Is  very  low  now.    The  teaching  load  as  far 
as  bookwork,  paperwork,  is  Just  weighing  them  down  so  heavily  that  they  resent 
spending  their  time  with  paperwork  and  not  actually  teaching.    If  we  had  aides 
to  helps  us  put  it  on  a  computer,  then  we  could  spend  more  time  teaching.  We 
did  have  one  aid  for  the  Basic  Skills  Program,  but  she  was  spread  so  thin  that 
she  was  Just  not  that  helpful  to  any  one  teacher.    Teachers  Just  realize  that 
there  are  not  enough  nours  in  the  day,  so  many  of  us  will  bring  stacks  of  work 
home,  and  I  woric  almost  every  night  until  8:00  or  9:00  o'clock,  sometimes 
midnight,  at  that  gets  old  after  a  .."hile.    You  have  to  enjoy  what  you're  doing, 
and  I  do  enjoy  being  with  children,  if  I  Just  had  more  time  to  teach  them 
instead  of  filling  out  reports." 

Some  teachers  described  the  personal,  human  costs  that  the  dec.  Ine  in 
morale  brought  on:  "You  Just  don't  have  the  enthusiara  you  once  had.    There  are 
times  when  maybe  I  ha^e  itot  been  as  patient  as  I  should  have  been.    You  seem  to 
get  wound  tighter  and  t-'^ter.    There  was  a  particular  time  when  I  really  lost 
my  temper.    I  was  so  firustrated  because  I  had  worked  so  very  hard  with  a 
child — I  would  stay  after  scMol  and  work  with  him  and  sometimes  I  would  even 
take  him  home«,    And  then  it  was  Just  nort  of  a  let  down... You  feel  like  you  are 
beating  your  head  against  the  wall.    I'm  coming  to  the  point  that  I'm  enjoying 
teaching  less.    It's  becoming  more  of  a  Job  instead  of  something  you  w?nt  to 
do.    If  I  thought  I  could  get  out  of  teaching  and  into  something  else,  I 
would.    I've  heard  that  from  a  lot  of  teachers.    Sometimes  you  can  put  up  with 
certain  things,  but  when  things  begin  to  overwhelm  you.  everything  seems  to 
Just  drag  you  down.    Most  of  the  teachers  I  talk  to  Just  hate  to  go  back  to 
school~that's  not  the  right  attitude.    It's  such  a  frustrating  thing  to  see 
really  good  teachers  Just  turned  off.    A  lot  of  people,  rather  than  go  through 
the  hassle.  Just  let  things  slide.    I  think  this  is  what'ri  happening.  Tney 
don't  resist,  tS^^y  Just  glv^i  ^n  to  it... I  don't  think  it's  only  me,  I  think 
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it's  a  lot  of  teachers.    And  I  discourage  every  child  that  that  comes" back  to 
talk  to  me  from  going  into  teaching.    I  tell  them  there's  no  future  in  it. 
That's  the  way  I  feel  right  now."    Said  another,  "In  the  past  I've  always 
enjoyed  teaching.    I  felt  like  I  helped  in  some  way.    Now  there  is  so  much 
other  than  teaching  I  am  requiref*  to  do.    I  guess  I  am  just  burned  out.    I  am 
not  looking  forward  to  the  Fall." 

That  teacher  commitment  may  be  reduced  by  policy  changes  is  another 
noteworthy  labyrinthine  of  education  reform  that  begs  research 
disentanglement.    If  policy  changes  pose  too  great  a  burden,  teachers  may 
disinvest  from  their  work,  "just  let  things  slide"  and  receive  social  support 
from  colleagues  for  the  divestiture*    The  possibility  that  Increased  demands 
which  teachers  perceive  as  barriers  to  their  classroom  eTectiveness  may  cause 
good  teachers  to  defect  must  be  entertained  and  examined.    In  sum,  researchers 
who  chart  policy  changes  need  be  mindful  of  this  fundamental  paradox:  The 
administration  of  HCT  may  place  new  demands  that  create  additional 
problems — lower  teacher  commitment — that  worsen  the  very  instructional  services 
the  reform  effort  intended  to  improve.    Problems  that  arise  from  the 
implementation  of  new  policy  are,  of  course,  not  intractable.    But  without 
research  activity  that  assesses  the  effects  of  policy  change  on  the  teacher 
workforce,  and  without  proper  procedures  that  feedbadc  essential  information 
and  recommendations  to  policy  makers,  there  will  be  no  corrective  action 
undertaken. 


Career  ladders-«>a  proposal  to  reward  and  encourage  teaching 
excellences-offers  teachers  increased  salaries  and  status  in  return  for  taking 
on  additional  school-system  responsibilities.    Well-conceived  CLPs  (e.g> 
Charlotte-Mecklenburg)  intend  to  bring  about  a  salutory  effect  on  schools 
thr6ugh  functional  assignments  in  which  talented  teachers  help  their  colleagiaes 
improve.    Functional  activities  Include  the  cdinical  supervision  of 
probationary  and  experienced  teachers,  and  the  onducting  of  school  inservice 
programs.    The  benefits  of  functional  assignments  clearly  lie  in  their 
potential  to  mold  schools  into  highly  collaborative  environments. 

The  Potential  of  Functional  Assignments 

Mediated  entry  into  teaching  may  help  beginning  teachers,  a  group  tliat 
dex'ects  most  frequently  from  the  workforce.    Where  novices  receive  no  guidance 
from  experienced,  successful  teachers,  they  undergo  severe  "reality  shock**,  as 
idealism  yields  to  the  understanding  that  before  one  can  teach,  it  is  necessary 
to  manage  students'  sometimes  unruly  behavior.    In  isolated  settings,  reality 
shock  prompts  rather  negative  work  orientations.    The  view  that  each  student 
has  different  needs  gives  way— usually  within  the  first  year— to  a  custodial 
view  where  the  maintenance  of  order  is  stressed,  students  are  distruste^S  and  a 
punitive  attitude  toward  control  prevails  (see  Ashton  et  al.    1983;  Bishop 
1977)- 

New  teachers  in  collaborative  settings,  however,  appear  to  maintain  the 
view  that  tending  to  the  individual  needs  of  students  is  essential  (Ashton  et 
al.    1983;  Bishop  1977).  The  emphasis  on  skill  development  in  managing  student 
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V  behavior  helps  beginners  avoid  a  custodial  attitude,  which  in  turn  lessens 
their  reality  shock.    Thus,  with  mentoring  by  highly  skilled  teachers,* 
beginners'  disaffection  and  subsequent  defection  from  workforce  may  decline 
substantially. 

Supporting  the  work  of  novices  benefits  experienced  teachers  as  well, 
because  the  challenges  3nd  problems  provide  greater  opportunity  for  public 
recognition  and  skill  utilization.    Indeed,  in  collegial  settings,  ;Veteran 
teachers  are  more  likeJ;/  to  perceive  themselves  as  influential  and  skilled  than 
teachers  in  isolated  settings  (Ashton  et  al.,  1983;  Chapman  &  Lowther  1982; 
Cohen  1973).  Providing  teachers  with  the  opportunity  to  assume 
responsibilities,  initiative,  and  authority  commensurate  with  their  talents  and' 
abilities,  and  recognizing  them  for  a  job  well  done,  may  increase  their  psychic 
rewards  and  their  likeLihood  of  remaining  in  the  workforce  (Chapman  &  Lowther 
1982;  Frataccia  &  Pennington  1982;  Rosenholtz  et  al.  1985). 

Of  even  greatei*  importance  to  experienced  teachers,  however  ,  is  the  degree 
of  professional  support  they  receive  from  colleagues.    Beginners  develop 
initial  skills  by  trial-and-error  learning  and  begin  to  deplete  their  personal 
fund  of  ideas  after  about  the  fifth  year  of  teaching  (McLaughlin  &  Marsh  1978; 
Summers  &  Wolfe  1977).  It  is  at  precisely  this  point  that  the  organizational 
conditions  of  teaching  become  most  crucial.    Indeed,  comparing  the  effects  of 
school  organization  on  relative  newcomers  who  had  taught  from  between  one  to 
five  years  with  veterans  who  had  taught  from  between  ten  to  fifteen  years, 
Rosenh  Hz  &  Greer  (1985)  found  that  organizational  conditions  explained  60t  of 
how  much  beginners  report  learning,  but  72 J  of  how  much  veterans  report 
learning.    For  experienced  teachers  particularly,  a  repository  of  ideas, 
techniques,  and  models,  like  a  centripetal  force,  pulls  them  toward  the  ^^ame 

V  mission  of  professional  Improvement  so  essential  to  their  continued  commitment 
to  the  profession. 

What  is  the  potential  for  career  ladders  to  develop  collaborative 
arrangements  in  schools?    Its  success,  of  course,  depends  on  how  carefully  the 
CLP  is  designed  and  implemented.    Hart  (1985)  Instructfully  details  one 
district's  attempt  to  institute  a  CL?  from  27  interviews  she  conducted  with  the 
district's  principals,*  teachers,  and  superintendent. 

Within  this  Utah  district,  the  superintendent,  assisted  by  a  task  force  of 
administrators  and  teachers  from  each  of  the  schools    developed  a  plan  aimed  at 
improving  instruction  by  marshalling  the  resources  of  experienced  and  talented 
teachers  for  school-wide  curriculum  and  Instruction  improvement  Torts. 
Explicit  in  the  plan  was  a  commitment  to  the  individual  school  as  the  most 
promising  organizational  level  for  improvement  and  change.    Ideas  were  carried 
back  and  forth  to  faculties  through  task  force  representatives.    By  negotiating 
rather  than  mandating  the  plan,  teachers  developed  a  sense  of  ownership. 
Indeed,  at  the  time  of  its  implementation,  80  percent  of  the  district's 
teachers  voted  in  favor  of  it. 

The  career  ladder  consisted  of  four  steps*    The  two  highest 
levels~teacher  specialist  and  teacher  leader—carried  with  them  $900,  plus  pay 
for  additional  contract  days  to  work  on  instructional  improvement  projects, 
clinical  supervision,  mentoring,  and  assisting  probationary  teachers  with 
professional  development.    Several  benefits  accrued  to  schools  during  its  first 
year: 

1.    During  the  extended  contract  days,  planned  opportunities  for  teacher 
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collaboration  were  organized  which  resulted  in  increased  faculty 
interaction  and  group  cohesiveness. 

2,  Teacher  leaders  provided  inservice  based  on  topics  identified  by 
faculties.    Teacher  specialist  roles  were  defined  by  each  school  and 
their  number  allocated  by  school  size  with  an  eye  toward  serving  specific 
faculty  needs  (e.g.  the  number  of  probationary  teachers  needing 
assistance  and  supervision,  specific  program  needs,  faculty  expertise, 
etc.) . 

3.  Probationary  and  other  teachers  began  to  request  technical  assistance  on 
their  own  initiative  from  teacher  leaders  who  had  been  selected  because 
they  were  esteemed  colleagues.    Teacher  leaders  benefitted  a  great  deal 
from  these  interactions  as  well. 

Teachers  at  all  levels  received  reinforcement  for  the  quality  of  their 
work.    Teachers  gained  .iK:re  knowledge  of  their  colleagues'  skills  and 
talents. 

5.    Because  teacher  leaders  were  empowered  and  legitimized  by  their 
expertise,  they, , shared  (albeit  sometimes  in  intimidating  ways) 
decision-making  responsibilities  with  building  principals.    As  one 
teacher  leader  explained  it,  '^There  are  nine  people  in  this  school  who, 
in  addition  to  the  principal,  think  about  the  whole  school  and  how  to 
Improve  it*^  (Hart  1985,  p.9)«    Principals  and  faculties  confronted  and 
communicated  with  each  other  on  professional  issues;  faculty  meetings 
evolved  into  substa::tive  decisions-making  arenas. 

In  addition  to  the  many  structural  features  that  accounted  for  the 
district's  success  Is  the  unwavering  leadership  of  the  superintendent.  It 
should  be  noted  that  at  the  onset  of  the  plan,  the  superintendent  of  four  years 
had  already  put  in  place  t^he  ingredients  of  ar  effective  district  (Murphy  4 
Hallinger  In  press).    For  instance,  the  central  office  supported  and  encouraged 
teacher  growth  by  bringing  in  resource  people  to  work  with  teachers  and  by 
implementing  a  clinical  supervision  model  for  principals.    In  improving  school 
quality,  others  have  noted  that  the  commitment,  involvement,  and  active  support 
of  the  central  office  is  pivotal  (Clark,  Lotto  &  Astuto  1984;  Huberman  &  Miles 
(1984),  Hallinger  &  Murphy  1982).  Certainly  a  superintendent  who  initiates 
experimentation  and  change  in  his  district  sets  the  tone,  invitation,  and 
expectation  that  others  will  do  likewise  in  their  schools. 


Unintended  Consequences  of  CLPs 

We  also  find  unincended  and  negative  consequences  in  the  forging  of  CLPs, 
and  among  their  many  variations  there  is  grist  for  the  policy  researcher  which, 
if  combined  with  a  mechanism  for  feedback,  results  in  guidance  for  the  reform 
itself.    Some  of  the  problems  states  and  localities  confront  in  their  efforts 
to  implement  CLPs  are  identified  below  (see  also  Rosenholtz  1985b). 

Evaluation  standards.    States  and  districts  can  and  are  identifying 
evaluation  criteria  that,  because  they  are  based  on  the  teaching  effectiveness 
literature,  will  probably  differentiate  effective  from  ineffective  teachers. 
Careful  validation  studies  still  oust  butress  local  measures.    However,  the 
challenge  to  devise  means  that  distinguish  competent  from  great  teachers  has 
not,  it  appears,  been  successfully  confronted.    Indeed,  in  the  districts 


(  studied  by  Hart  (1985)  and  by  Natriello  &  Cohn  (1984),  the  evaluation 

procedures  plagued  both  localities  for  their  lack  of  clarity  and  defirtition. 
If  exceptional  teaching  remains  more  a  reputational  than  an  observable 
phenomenon,  the  implications  for  changing  good  into  great  teachers  are  few. 
Moreover,  as  we  shall  see  below,  the  success  of  CLPs  is  jeopardized  if  teachers 
do  not  accept  new  testing  procedures  as  a  legitimate  gauge  of  their  classroom 
effectiveness. 

The  Southeastern  teachers  we  interviewed  were  confronting  the  state's 
evaluation  and  selection  procedures  for  career  ladder  advancement  for  the  first 
time.    Nearly  two-thirds  of  them  challenged  the  fairness  and  legitimacy  of  the 
evaluation  system.    For  example,  over  half  the  teachers  charged  that  the 
classroom  observation  procedures  and  the  materials  submitted  by  the  career 
ladder  applicant  measured  teacher  cunning  and  endurance  more  than  their 
effectiveness,  e.g.,  "You  can  do  anything  for  a  few  days  if  you  know  an 
evaluator  is  coming  in";  "The  evaluators  only  make  three  observations,  two  of 
which  are  arranged  with  the  teacher.    You  can  fool  anybody  for  a  couple  of 
days";  "I  was  observed  with  the  criteria  they  use  in  the  career  ladder.  I 
thought  that  was  kind  of  farce  because  you  know  when  they're  coming.  They 
don't  see  the  true  teacher";  "Anyone  can  put  on  a  good  show  when  they  are  being 
evaluated";  "You  can't  judge  a  teacher  by  three  thirty  minute  visits";  "The 
evaluators  who  came  in  were  nitpicking.    They  were  looking  for  picky  things. 
They  [the  teachers  who  ^plied]  would  tell  me  things  they  got  marked  down  on, 
they  got  real  discouraged,  real  uptight,  a  lot  of  ti  em  dropped  out,  and  the 
ones  who  went  on  were  very  depressed  because  they  didn't  make  it«    I  jusc  had 
the  feeling  that  there  weren't  any  funds  and  they  had  to  make  it  hard,  hard." 

The  applicant  for  the  two  highest  levels  of  ti"^s  CLP  is  require  to  submit 
'  an  astonishing  array  of  background  materials  such  as  sample  lesson  plans, 

behavioral  objectives,  and  teacher-made  materials,  *4iich  apparently  was 
weighted  more  heavily  than  actual  classroom  observations.    According  to  teacher 
reports,  these  may  be  fabricated  without  the  dimmest  glimmer  of  relevance  to 
one's  actual  classroom  performance.    Typical  of  their  comments:  "You  have  to 
write  lesson  plans,  unit  pi ^ns,  and  document  everything  with  letters.  People 
can  really  make  this  stuff  up  if  they  want  to.    I  know  people  who  are  doing 
that.    The  main  thing  is  that  it  doesn't  show  whether  you're  a  good  teacher  or 
not";  "A  person  who  is  a  good  test-taker  and  does  well  assembling  material 
could  be  a  rotten  teacher.    They  could  fool  anybody";  "Just  because  you  can 
write  down  beautiful  words  in  a  portfolio  does  not  make  you  a  Master  Teacher. 
I've  heard  talk  that  some  teachers  are  setting  othert^  to  write  their 
portfolio.    I  don't  know.    I  can't  prove  that.    But  you  can  always  get  somebody 
to  do  something  for  you  for  a  price." 

Worse  still  is  the  pervasive  complaint  that  the  construction  of  the 
portfolio  robbed  students  as  well  as  family  members  of  applicants'  time  and 
attention:  "The  hours  needed  to  develop  a  good  portfolio  do  not  reflect  a  good 
teacher,  so  I  decided  to  drop  out.    I  also  think  that  all  those  hours  take  away 
from  the  children.    The  teachers  don't  go  in  fresh.    Only  one  teacher  in  our 
school  stayed  in";  "The  teacher  across  the  hall  was  there  'til  7:30  at  night. 
I  mean  for  months.  You  have  all  you  can  do  to  teach  school  without  having  this 
extra  burden  on  you";  "A  friend  of  mine  who  is  a  very  good  teacher  applied. 
She  felt  like  she  had  neglected  her  child  because  this  had  taken  so  much  time; 
her  weekends,  hours  upon  hours  of  things  that  weren't  really  applicable  to 
great  teaching";  "A  good  friend  of  mine  applied  for  career  level  three.  She 
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gave  her  whole  year  to  three.    Not  only  did  it  take  away  time  from  hef 
classroom;  it  took  away  from  her  six-year-old  duaghter,  who  finally  one  night 
begged  her  mother  to  just  take  the  time  to  talk  with  her,  because  she  spent 
every  waking  minute  working  on  that  stupid  portfolio,  and  all  that  junk  that 
they  wanted  in  there.    She  had  to  croose  one  or  the  other". 

Repeatedly  teachers  strv:;3sed  that  either  they  or  their  best-performing 
colleagues  chose  to  devote  their  year  to  students  rather  than  to  developing  a 
portfolio.    "There  are  some  extremely  good  teachers  who  are  not  going  to  apply 
simply  because  of  the  time  factor  that  the  others  have  gotten  involved  in";  "My 
principal  really  encouraged  me  to  apply.    He  said  that  I  could  do  It,  and  that 
I  was  already  doing  this  and  already  doing  that.    And  I  did  sign  up  for  it. 
And  then  they  started  making  changes  and  adding  tills  and  adding  that,  and  you 
had  to  go  take  this  test  over,  or  go  take  this  test  in  addition  to  that 
test...That  was  taking  away  from  my  time,  and  I  Just  felt  that  I  really  needed 
the  time  to  work  on  things  to  help  my  children  and  things  for  my  classroom.  So 
I  dropped  out";  "The  time  I  spend  on  my  Job  will  be  spent  on  preparing  cleasses 
not  on  a  portfolio,  or  running  down  the  hall  asking  people  to  sign  papers  that 
I  have  had  a  student  teacher  or  a  field  trip.    I  use       time  and  energy  on  my 
job";  "So  many  of  the  teachers  who  are  excellent  dldn*t  apply  because  they  Just 
don^t  have  the  time.    If  you  did  lesson  plans  the  way  they  wanted,  you  vrouldn't 
have  a  home  life." 

Distributive  Justice.    That  career  promotions  may  be  based  on  faulty 
evaluation  practices  may  stir  teachers'  sense  of  injustice.    If  the  procedures 
by  which  the  distribution  of  rewards  are  precelved  as  unjust  or  unfair— I.e. , 
If  the  contributions  of  rewarded  teachers  are  perceived  as  no  greater  than 
those  of  the  unrewarded~problems  of  distributive  Justice  arise.  Unrewarded 
Individuals    eact  to  Injustice  by  attempting  to  restore  equity  in  the  setting. 
Typically  th^y  may  alter  the  level  of  their  own  contributions  downward  In  the 
direction  of  lower  productivity,  or  they  may  leave  the  situation  altogether 
(Cook  4  Hegtvdt  1983). 

Nowhere  Is  the  theory  of  distributive  Justice  better  Illustrated  than  in 
Natrlello  and  Cohn*s  (1985)  case  study  of  one  school  district's  efforts  to 
implement  merit  pay.    Here  the  Board  of  Education  eliminated  all 
across«-the«-board  pay  increments,  using  only  competitive  merit  increments  to 
raise  teachers'  salaries,  a  decision  that  brought  scrutiny  to  the  accuracy  of 
evaluations.    According  to  some  teachers,  the  evaluation  system  forced 
principals  to  focus  on  relatively  trivial  aspects  of  teaching  in  order  to  make 
performance  distinctions.    Many  teachers  could  not  understand  what  they  could 
possibly  do  to  improve.    And  because  they  received  only  average  increment 
raises  Instead  of  maximun  raises,  teachers  who  once  felt  superior  now  felt  as 
though  they  were  not  performing  adequately.    The  end  result  for  some,  as  the 
theory  of  distributive  Justice  predicts,  was  a  reduction  in  teacher 
commitment. 

In  our  study,  taachers'  persistent  challenge  to  the  soundness  of 
evaluation  practices  caused  !aany  to  forebode  trouble  when  rewarded  teachers 
begin  to  make  substantially  higher  s^Mry  than  others.    Typical  of  their 
comments  were  the  following:  "I  really  don't  feel  like  the  teachers  wno  applied 
[to  the  CLP]  are  doing  a  better  Job.    There's  going  to  be  a  lot  of  conflict"; 
"Neither  of  the  two  teachers  who've  applied  for  the  top  career  levels  are  the 
best  teachers  in  this  school.    If  they  make  it,  the  rest  of  us  will  resent  it 
terribly." 
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We  interviewed  some  teachers  just  after  career  ladder  selections  had  been 
publically  announced.    Each  expressed  grave  reservation  and  surprise  about  at 
leabt  some  of  those  chosen  to  advanced:  "I  know  someone  who  just  got  to  career 
ladder  position  two  and  she's  one  of  the  poorest  teachers  I  know.    I  like  her 
as  a  person,  but  she  is  a  lousy  teacher";  "I  think  the  Carrer  Ladder  has 
affected  the  morale  of  teachers.    It  used  to  be  your  morale  was  based  on 
whether  you  felt  you  were  a  success.    You  could  be  the  best  teacher  possible. 
Some  teachers  that  are  not  nearly  as  good  as  other  teachers  have  advanced  or 
succeeded  passing  a  certain  stage  and  it's  obvious  that  they  are  not  as  good  a 
teacher  as  someone  who  did  not,  and  that  Just  shows  it's  not  Marking.    And  it's 
going  to  make  that  teacher  feel  like  'Why  should  I  give  all  I  have  anymore. 
What's  the  use?    Maybe  I  should  go  and  practice  doing  what  it  takes  to  pass  the 
test  and  not  worry  about  what  goes  on  in  my  classroom,'" 

Problems  of  distributive  justice  are  significant  not  only  because  they  may 
reduce  the  teaching  commitment  of  the  unrewarded;  they  may  also  inhibit  school 
improvement  if  teachers  cannot  accept  the  legitimacy  of  conveyers*  advice, 
assistance,  and  suggestions.    How  teacher  selection  for  career  ladders  alters 
faculty  interaction,  then,  has  profound  consequences  for  the  ethos  of  the 
school. 

Evaluation  and  collaboration.    As  a  matter  of  fact,  a  serious  and 
consistent  foreboding  by  roughly  a  third  of  the  teachers  in  our  Southeastern 
sample  about  the  evaluation  instrument  employed  by  the  state  was  its  threat  to 
the  positive  collaborative  relations  teachers  presently  enjoyed.  Teachers 
predict  an  end  to  offers  of  assistance  among  colleagues  because  all  portfolio 
materials  submitted  by  applicants  for  evaluation  to  the  CLP  had  to  be 
accompanied  by  evidence  of  their  originality:  "I*m  not  in  favor  of  the  Master 
Techer  Plan.  It*s  too  nuch  dog-eat-dog.    I  don't  like  the  bit  of  someone 
getting  an  idea  and  wanting  to  close  their  door  and  not  share  anything  with 
others.    It  hurts  the  children.    When  you  do  something  good,  you  really  ought 
to  say,  'Hey,  this  really  works  well— you  ought  to  try  it*.    Teachers  are  not 
going  to  do  that  if  they  have  to  document  everything  they've  done  as  original. 
It's  really  hard  because  if  you  do  something  really  well,  you  sure  don't  want 
anyone  else  to  take  credit  for  It.    That's  not  the  way  education  should  be. 
That  Is  not  for  the  good  of  the  children." 

"One  of  the  things  that  I'm  worried  might  be  negatively  affected  by  the 
career  ladder  is  sharing  Ideas.    As  part  of      application  I  had  to  show  them  a 
portfolio  of  all  the  Ideas  I  had  accumulated.    I  think  that  we  would  wither  and 
die  if  we  couldn't  share  things  with  each  other.    I'm  talking  both  about 
problems  and  a  lot  of  good  things  that  happen  that  we  just  want  to  share  with 
others." 

"I  think  the  master  teacher  plan  can  lead  to  hoarding.    We've  talked  about 
that  in  our  school.    It  s^^ems  that  if  you  don't  desire  master  teacher  status 
then  you  won't  have  the  problem  with  hoarding.    If  you're  really  intent  upon 
being  a  master  teacher,  then  I  think  it  might  cause  you  to  be  a  less  sharing 
person." 

"Teachers  share  a  lot  here.    They  are  very  professional,    but  the  career 
ladder  is  changing  all  that.    It  used  to  be  that  we  all  had  the  same  roals,  so 
we  helped  each  other.    Now  that  recognition  is  being  directed  to  individuals, 
everybody  is  trying  to  be  their  best  to  help  themselves,  not  others." 

"Teachers  were  more  open  and  willing  to  share  their  ideas  and  their  plans 
and  work  together  and  now  it's  kind  of  like  'Let  me  do  my  thing  and  make  it  as 


good  as  I  can  so  I  can  make  a  good  mark  for  me.*  I  really  think  iV  s  ( 
detrimental," 

If  the  means  to  select  teachers  for  career  ladder  placement  are 
ill-designed,  if  they  are  not  thoroughly  informed  by  an  understanding  of  the 
nature  of  school  effectiveness  and  the  dynamics  of  group  behavior,  they  are  not 
likely  to  succeed.    Should  the  costs  of  career  ladders  turn  out  to  be  the 
collegial  relations  needed  to  enhance  teacher  learning  and  commitment,  in  them 
we  have  the  makings  of  a  national  educational  failure  at  the  very  point  in  our 
history  that  vie  need  a  major  success. 

Quota  .systems.    A  separate  issue  in  the  design  of  career  ladders  is  the 
question  of  scarce  rewards — plans  can  either  promote  all  who  meet  the  standards 
of  performance,  or  invite  wide  application  and  competitively  choose  the  best 
qualified  applicants  from  among  those  who  apply  (Murphy,  Peterson  &  Kauchak 
1985).  To  be  sure,  competitive  rewards  are  lauded  by  some;  Murphy  et  al. 
(1985)  argue  that  teachers  are  more  likely  to  accept  a  decision  if  they  lose  a 
promotion  to  another  person  rather  than  If  the  accuracy  of  the  evaluation  is  at 
stake.    Several  states  and  localities  do  in  fact  create  scarce  rewards  by 
limiting  the  number  of  teachers  who  can  be  recognized  (e.g.  Arizona, 
California,  Utah). 

But  from  a  sociological  point  of  view,  we  know  that  competitive  rewards 
have  unintended  and  negative  consequences  for  group  interaction.    There  is 
evidence  thet  competitive  rewards  function  to  close  rather  than  open 
communication. and  sharing  among  those  who  work  together  as  well  as  to  destroy 
trust.    In  competitive  settings  encouragem.ent  among  group  members  is 
substantially  reduced,  and  their  problem-^solving  capacity  diminished.    In  fact, 
competitive  conditions  may  lead  people  to  deliberately  frustrate  the  attempt  of 
others*  to  succeed  (see  Rosenholtz  1985b  for  a  review).  ( 

Because  skill  development  for  teachers  depends  so  heavily  upon 
collaborative  support  and  exchange,  it  seem  reasonable  to  predict  that 
competitive  rewards  will  substantially  thwart  efforts  to  improve.  Indeed, 
preliminary  support  for  this  assertion  comes  from  a  study  of  Great  Britain* s 
c£.reer  ladder  plan  (Blomquist  et  al.    1984).  In  most  British  primary  schools, 
where  the  range  of  differences  in  salary  is  modest,  teachers  share  a  closeness 
and  work  cooperatively.    But  in  secondary  schools,  where  salary  ranges  are  far 
greater  and  where  competition  for  prr^otions  is  keener,  many  teachers 
attempting  to  advance  do  not  want  to  share  their  ideas  unless  they  received 
full  credit  for  them. 

In  fact,  teachers  involved  with  reforms  studied  by  Blomquist  et  al  (1984), 
Hart  (1985),  and  Natriello  &  Cohn  (1984)  lowered  their  school  commitment  if 
they  were  not  promoted.    They  became  unwilling  to  perform  tasks  on  the  school* s 
behalf  unless  there  was  personal  benefit  to  be  derived.    And  they  resented 
those  who  were  promoted,  making  school  betterment  an  activity  restricted,  in 
all  likelihood,  solely  to  the  chosen  few. 

The  evolution  of  changes  among  teaching  colleagues,  therefore,  becomes 
critical  to  document.    How  will  collaborative  exchange  among  teachers  be 
affected  by  CLPs?  What  additional  training  will  be  needed  to  help  master 
teachers  succeed  in  their  many  functional  assignments?    What  is  the  best 
mechnism  for  providing  it?    What  are  the  characteristics  of  functional 
assignments  that  appear  most  promising  in  bringing  about  school  improvement? 
How  can  competent  teachers  who  are  not  selected  for  advancement  still  be  made 
to  feel  appreciated?    What  will  happen  to  their  commitment  to  the  school? 
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Clearly,  much  of  the  worth  of  policy  research  that  I  argue  should  commence, 
hinges  on  the  fact  that  it  vail  provide  a  reliable  means  of  assessing  the 
teaching  occupation  during  a  time  of  important  changes,  of  monitoring  those 
changes  as  they  occur,  and  of  supplying  essential  information,  analysis  and 
advice  to  those  Wi  j  will  be  making  them  occur. 

Allocation  inequities.    The  allocation  of  master  teachers  throughout  a 
school  system  or  region  has  been  neglected  by  many  CLPs,  despite  the  fact  that 
'*good**  schools  have  an  easier  time  recruiting  and  retaining  exemplary  teachers 
than  "bad"  schools,  and  therefore  have  a  disproportionate  share  (see  Rosenholtz 
1985a).  That  all  schools  need  access  to  the  valuable  resource  of  good  teaching 
seems  obvious.    Without  small  cadres  of  good  teachers  in  every  school,  there  is 
little  support  to  ease  transitions  into  teaching  or  to  provide  for  the 
professional  development  of  experienced  or  master  teachers  themselves. 

The  Charlotte-Mecklenberg  Career  Ladder  Plan  represents  a  significant 
departure  from  this  omission,  however.    Here  teachers  advancing  to  the  highest 
levels  must  be  willing  to  transfer  to  different  schools  as  need  for  their 
special  skill  arises.    But  what  are  the  costs  of  high  mobility?    In  Great 
Britain,  allocative  inequities  are  prevented  by  national  advertisement  and 
competition  when  positions  arise.    Due  to  the  large  nt/iber  of  promotions  that 
are  possible  (8  different  salary  points  along  5  scale*),  however,  ambitious 
entrants  to  the  career  ladder,  in  order  to  advance  rapidly,  move  frequently 
from  one  place  to  the  next,  developing  little  school  commitment  along  the  way 
(Blomquist  et  al.    1984).  High  mobility  of  this  sort  may  have  deleterious 
effects  by  limiting  opportunity  to  develop  the  sort  of  collegial  relations  in 
schools  that  make  teacher  and  student  learning  possible. 

It  is  neither  the  intent  of  any  CLP  to  make  good  teachers  inaccessible  to 
poorer  schools,  nor  to  encourage  their  mobility  from  schools  before  the  impact 
of  their  efforts  can  be  fully  realized.    These  and  other  trade-offs  that  are 
inherent  in  the  many  structural  changes  proposed  for  the  teacher  workforce 
deserve  and  require  research  attention  to  enhance  their  understanding  and 
impact. 


CONCLUSION 

The  next  decade  will  be  a  time  of  enormous  turmoil  in  the  teaching 
occupation.    A  majority  of  our  teaching  workforce  in  1992  will  be  people  who 
are  not  presently  employed  (NCES  1984).  That  means  well  over  a  million  new 
teachers  will  be  entering  the  classroom  during  the  next  six  years.    Who  they 
are,  how  they  will  be  trained  and  selected,  what  kinds  of  experiences  and 
abilities  they  will  bring  with  them,  and  what  kinds  of  conditions  they  will 
encounter  in  the  schools  where  they  woric  are  questions  of  more  than  academic 
interest.    For  this  huge  turnover  is  beginning  Just  as  the  unsatisfactory 
quality  of  American  schooling  has  seized  the  interest  of  policy  makers  at  all 
levels  to  make  changes  intended  to  improve  that  quality.    And  the  major  object 
of  these  changes  is  the  teaching  workforce  itself. 

The  combination  of  demographic  forces  and  conscious  policy  decisions  makes 
for  a  period  of  extraordinary  volatility  within  and  around  the  teaching  force. 
There  is  also  the  eager  anticipation—and  hope~that  through  the  many 
permutations  of  policy  interventions,  we  will  ult innately  improve  the  current 
lackluster  performance  of  schools.    In  reality,  however,  not  enough  is  known 
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about  teachers  and  teaching  to  provide  a  steadfast  base  from  which  policy 
changes  can  be  confidently  launched.    Where  purposive  efforts  to  improve 
quality  are  mounted,  they  may  hit  with  highly  uneven  impacts  if  their  effects 
are  not  properly  anticipated-    Further,  without  a  satisfactory  "feedback" 
mechanism,  there  is  no  avenue  to  supply  continuing  ir^ight,  constructive 
criticism,  and  dispassionate  scrutiny  to  assist  policy-makers  in  knowing 
whether  their  efforts  are  well-designed  to  solve  actual  problems  or  merely 
cosmetic  changes  that  never  penetrate  beneath  the  surface. 

The  task  of  buttressing  policy  changes  with  real  Information,  accurate 
analysis,  and  sound  recommendation  falls  upon  the  research  community.    Such  an 
ambitious  enterprise  has  many  dimensions:  tracing  and  monitoring  reform 
decisions;  providing  thoughtful  and  informed  comment  about  them;  offering 
technical  advice  to  those  who  will  be  designing,  implementing  and  evaluating 
them;  and  keeping  in  the  public  eye  the  conditions  in  education  generally,  and 
the  teaching  occupation  particularly,  that  create  compelling  rationale  for 
well-conceived  changes.    Only  then  can  the  promise  of  policy  intervention 
become  more  than  another  episodic  chapter  in  the  history  of  American 
education. 
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Assessing  American  Education: 
Shrinking  Resources,  Growing  Demands 

National  statistics  on  education  are  amassed  in  order  to 
monitor  the  extent  to  which  individuals  are  being  educated  and 
the  quality  of  education  they  receive*  These  statistics  are 
necessary  for  planning  future  educational  efforts  and  for 
assessing  the  impact  of  past  and  current  educational  policy  and 
practice.  Few  people  appear  satisfied  with  the  American 
educationa 1  system.  In  1983,  the  "year  of  the  reports",  sever a  1 
studies  critical  of  American  education  were  published  (Howe, 
1984).  These  reports  (e.g..  National  Commission  on  Excellence  in 
Education,  1983)  call  for  greater  attention  to  "excellence"  in 
education.  At  the  same  time,  many  individuals  insist  that  the 
race/ethnici ty,  class,  and  gender  biases  pervasive  in  American 
society  must  not  be  reflected  in  children's  school  experiences  or 
in  their  achievement  levels  (see,  for  example,  Harvey,  1985;  S. 
Klein,  1985).  Further,  schools  are  expected  to  do  more  than 
focus  exclusively  on  the  teaching  of  narrowly  defined  cognitive 
skills.  Because  it  is  an  almost  universal  experience  for 
American  children,  occupying  much  of  their  lives,  schooling  is 
expected  to  facilitate  the  healthy  development  of  children  into 
competent,  well-adjusted  adults.  In  short,  many  varied  demands 
are  being  made  of  the  educational  system,  at  a  time  when  public 
support,  particularly  at  the  federal  level,   is  declining. 

In  a  time  of  shrinking  funds  for  education,  one  could  argue 
that  scarce  resources  should  be  channelled  into  direct  services 
for  children.  Careful  monitoring  of  edcrration,  however,  becomes 
even  more  critical  in  times  of  financial  difficulty  so  that  the 
effects  of  cutbacks  and  of  continued  spending  can  be  documented. 
Bell  (1982)  includes  conducting  and  financing  educational 
research,  and  strengthening  national  research  capabilities, 
especially  at  universities,  as  legitimate  functions  in  a  limited 
federal  role  in  education.  Even  a  conservative  position,  then, 
acknowledges  the  strong  need  for  educationa 1  research.  Data 
collection  should  be  carefully  planned,  to  avoid  unnecessary 
expenditures  and  repetition.  Collaboration  among  agencies  and 
individual  researchers  will  be  necessary*  Efforts  such  as  the 
recent  Interagency  Conference  on  Child  and  Family  Statistics 
(Zill,  Peterson,  &  Moore,  1984),  aimed  at  coordinating  and 
improving  national  statistics  on  children  generally,  including 
those  on  education,  should  be  continued.  Although  funding  for 
data  collection  is  a  serious  issue,  the  cost  of  various  data 
collection  programs  will  not  be  addressed  directly  in  this  pap'sr. 
Wisdom  and  efficiency  in  spending  are  important  goals;  however, 
it  is  a  truism  that  many  other  areas  of  governmental  spending  are 
far  more  wasteful  and  less  useful  to  the  society  than  is  the 
education  of  America's  children. 


This   paper  describes  critical    issues   in  elementary  and 
secondary   educat  ion   and    the   manner    in   which   national  data 
collection  efforts  might  address  these  issues  effectively.  These 
(  issues    include,    first,    the    equal    importance   of   equity  and 

^  excellence  as  goals  of  American  education.     Several  phenomena 
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related  to  the  goals  of  equity  and  excellence  are  discussed, 
including  bilingual  education,  private  ochools,  use  of  computers 
in  schools,  drop-outs,  and  the  transition  from  school  to  work.  A 
second  major  issue  is  the  development  of  students  from  childhood 
through  adolescence.  Developmental  issues  include  the  need  for 
longitudinal  studies,  especially  of  elementary  school  children, 
preprimary . school  programs,  and  adolescent  development.  Finally, 
the  quality  of  instruction,  including  teacher  preparation  and 
classroom  processes,  and  public  perceptions  of  education  are 
discussed. 

• 

Excellence  and  equity  in  education 

A  foremost  goal  of  the  American  educational  system  is  the 
development  of  students  into  literate,  critical-thinking  citizens 
who  function  well  in  a  complex,  technological,  democratic 
society.  The  elementary  and  secondary  educational  system  should 
prepare  students  for  adult  roles  that  are  both  productive  and 
personally  satisfying.  For  some  students,  this  preparation  will 
lead  to  higher  education  and  for  others,  the  transition  into  the 
labor  force.  .  . 

The  1983  reports  expressed  the  fear  that  American  children's 
education  is  not  sufficient  to  allow  the  country  to  compete 
favorably  with  other  industrial  nations.  Appropriate  indicators 
of  the  quality  of  education  American  children  receive  should  be 
available  and  should  allow  for  meaningful  comparisons  among 
states,  as  well  as  with  other  countries.  In  1980,  40  states  had 
minimum  competency  testing  (Whalen,  1984)  but  these  programs 
varied  greatly  from  state  to  state.  Indicators  such  as  SAT  and 
ACT  scores,  reported  in  the  State  Education  Statistics  Chart, 
have  some  utility  but  do  not  allow  complete  across-state 
comparisons,  because  the  percentage  of  students  taking  each  test 
varies  from  staie  to  state.  An  exclusive  reliance  )n 
standardized,  multiple-choice  test  formats,  however,  is  not 
desirable.  Measures  of  critical  thinking  must  be  available. 
Test  items  are  needed  that  assess  higher-level  processes  rather 
than  only  the  recall  of  basic  facts.  Students'  ability  to  write 
must  be  assessed.  Other  abilities  and  skills  judged  to  be 
important  in  the  society  should  be  assessed.  For  example,  do  we 
expect  our  students  to  have  some  knowledge  of  music,  art, 
languages  other  than  English?  Is  physical  and  nutritional 
education  an  important  issue,  given  the  recent  reports  of  low 
physical  fitness  in  American  school  children?  If  so,  these  must 
be  assessed  in  some  meaningful  way. 

Equity  issues.  The  SAT  and  ACT  also  have  limited  utility 
as  indicatoTs  ol  the  status  of  American  education  because 
segments  of  the  population  will  not  take  these  tests  and  will  not 
attend  college.  This  fact  represents  a  most  difficult  issue. 
Excellence  and  equity  must  be  simultaneous  goals  of  the 
educational  system;  both  must  be  included  in  assessments  of 
educational  outcomes.  "Qual i ty"  and  "excel lence",  however, 
appear  to  have  become  codewords  for  lessened  concern  with 
equality  and  equity  in  education.     Some  proponents  of  excellence 
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in  education  appear  to  believe  that  the  only  way  to  achieve  that 
goal  is  by  focusing  on  those  children  already  best-served  by  the 
American  education  system  and  making  them  better..  Other 
educators  claim  to  believe  that  equity  for  minorities  is  no 
longer  an  issue^  except  in  the  most  minor  ways^  because  of  the 
changes  of  the  1960s  and  1970s.  In  outlining  a  limited  federal 
role  in  education,  Bell  (1982)  includes  protection  against 
discrimination  and  'violations  of  civil  rights,  but  with  an 
emphasis  on  persuasion  rather  than  enforcement.  This  statement 
exemplifies  the  current  lessened  interest  in  equality  of 
opportunity  and  outcomes  for  those  groups  in  society  underserved 
by  the  educational  system.  Excellence  in  education,  however, 
should  be  a  goal  for  all  students.  Quality  without  equality  will 
mean,  simply,  continued  discrimination. 

Equity  for  the  poor,  minorities,  and  females  is  a  major 
theme  within  all  the  issues  raised  in  this  paper.  (Equal  access 
to  education  for  handicapped  children  also  is  an  important  issue, 
but  will  not  be  addressed  directly.)  A  growing  number  of 
American  children  live  in  poverty.  Currently,  22%  of  American 
chidren  live  in  poverty,  compared  ♦^o  18.3%  in  1980.  Poverty 
levels  vary  greatly  by  region  and  state,  ranging  from  7.5%  of  the 
school-age  population  in  Wyoming  to  30.4%  in  Mississippi. 
Minorities  account  for  26.7%  of  public  school  enrollment,  ranging 
dramatically  from  .9%  in  Maine  to  96.4%  in  the  District  of 
Columbia  (U.S.  Department  of  Education,  1985).  Although  they  may 
be  approximately  equal  in  number  with  their  male  counterparts, 
girls,  along  with  the  poor  and  minorities,  continue  to  experience 
inequities  in  the  educational  system.  The  achievement  of  poor, 
minority,   and  female  students  thus  is  a  major  issue. 

Many  reports  do  not  provide  adequate  information  on  race, 
sex,  and  income  level  of  students.  Reports  of  education 
statistics  provide  some  separate  data  for  Blacks  but  not  always 
in  the  most  informative  manner.  Little  information  about 
Hispanics  is  provided  and  even  less  about  other  minority  groups, 
such  as  American  Indians.  (See  La  Fromboise  &  Plake,  1983,  for 
discussion  of  research  needs  of  American  Indians).  Data 
sometimes  are  reported  by  race  and  then  separately  by  sex,  rather 
than  by  sex  within  race.  Gender  differences,  however,  may  not  be 
uniform  for  whites  and  minorities  (Reid,  1982;  Scott-Jones  & 
Nelson-Le  Gall,  in  press).  Similarly,  breakdowns  by  economic 
status  are  given  for  the  entire  sample  rather  than  within 
minority  groups.  Data  should  be  reported  by  income  level  within 
minority  groups,  to  avoid  the  usual  confounding  of  race  and 
economic  status.  In  those  instances  where  some  information  on 
income  level  is  provided,  it  is  usually  at  the  aggregate  rather 
than  the  individual  level.  For  example,  reports  of  mathematics 
performance  from  the  National  Assessment  of  Educational  Progress 
(NAEP)  (Weinberg,  Gerald,  &  Tron,  1984)  give  mean  performance  by 
type  of  communi ty--rura 1 ,  urban  disadvantaged,  and  urban 
advantaged. 

The  achievement  of  poor,  minority,  and  female  students  must 
be  carefully  assessed.     The  effective  schools  movement  has 
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directed  attention  to  achievement  in  schools  with  large  numbers 
of  poor  minority  students  and  has  highlighted  the  fact  that  poor  ( 
minority  children  can  benefit  from  good  educational  efforts.  It 
has  focused  attention^  however^  on  standardized  test  scores  as 
the  major  criterion  for  effective  schooling.  Assessment  should 
include  comprehensive  measures  of  learning  and  thinking  that  are 
appropriate  for  minority  students.  Sex  differences  in 
performance^  especially  in  math  and  science  (see  Stage, 
Kreinberg,  &  Eccles,  1985) r  need  to  be  monitored. 

Integration  of  public  and  private  schools  must  be  monitored. 
In  addition,  segregation  of  students  via  ability  grouping  and 
tracking  must  be  monitored.  Ability  grouping  in  classrooms  may 
result  in  an  inferior  education  for  minority  and  poor  students. 
Minority  students  tend  to  be  o verrepresented  in  lower  level 
groups  and  tracks,  where  teachers  spend  less  time  on  academic 
instruction  and  more  time  on  discipline  and  classroom  management 
(Hallinan,  1982). 

A  biennial  or  triennial  report  on  the  education  of  children 
living  in  poverty  was  suggested  at  the  Interagency  Conference  on 
Child  and  Family  Statistics  (Zill,  Peterson,  &  Moore,  1984), 
Reports  on  the  education  of  racial/ethnic  minorit  as  also  would 
be  useful.  Oversampling  of  minority  groups  was  recommended  by  the 
Interagency  Conference  on  Child  and  Family  Statistics.  Because 
national  probability  samples  will  include  only  small  numbers  of 
Blacks,  Hispanics,  Native  Americans,  and  Asian  Americans, 
oversampling  of  these  groups  may  be  necessary  for  meaningful  ( 
conclusions  about  them.  Supplementary  samples  could  be  obtained 
from  geographic  areas  with  high  numbers  of  specific  minority 
groups.  The  whole^  issue  of  cultural  pluralism  needs  to  be 
addressed.  Not  only  are  numbers  of  minorities  in  schools 
important  but  also  respect  for  and  acknowledgment  of  people  of 
different  racial  and  ethnic  backgrounds. 

Bi 1 ingua 1  educat  ion.  Bilingualism  is  an  issue  in  some 
regions.  Children  may  be  labeled  "language  minority"  if  they  or 
their  parents  use  a  language  other  than  English  primarily  or 
"often".  Students  are  designated  "limited  English  proficient"  if 
they  score  below  a  cut-off  point  on  a  test  of  English  proficiency 
(Weinberg,  Gerald,  &  Tron,  1984).  States  with  the  highest 
percentages  of  low-scoring  children  are  New  Mexico,  New  York, 
California,  Aiizona,  Hawaii^  and  Texas.  Approximately  V3%  of  the 
3.6  million  children  labeled  limited  English  proficient  are 
Hispanic  (Rotberg,  1982),  although  the  majority  of  U.  S.  Hispanic 
children  do  not  attend  bilingual  classes  (Otheguy,  1982). 
Because  of  their  greater  numbers,  Hispanics  have  been  the  subject 
of  research  mure  frequently  than  other  language  minority  groups, 
such  as  Asian  Americans  or  American  Indians  (Steinberg,  Blinde,  & 
Chan,  1984),  although  the  court  case,  Lau  v.  Nichols,  1974, 
resulting  in  the  establishment  of  bilingual  education,  was 
brought  on  behalf  of  Chinese  students  (Sinclair,  1983). 

Disagreement  exists  regarding  the  number  of  children  who 
need  special  English  language  services  (Cooke,  Ginsberg,  &  Smith, 


1985;  NCES  Indicators,  1985).  Cooke  et  al.  point  out  that  many 
children  scoring  below  the  cut-off  use  English  as  their  main  or 
only  language  and  therefore  do  not  need  special  English  services. 
Unless  the  test  is  not  valid  or  the  cut-off  point  is  too  high, 
however,  it  seems  important  to  provide  services  to  low-scoring 
children,  even  if  they  do  use  English.  Currently  available  tests 
of  language  proficiency  a,re  of  questionable  reliability  and 
validity,  and  use  norms  derived  from  nonrepresentati ve  samples 
(Padilla  &  Lindholm,  1984;  Rotberg,  1982).  Most  important,  the 
tests  do  not  measure  the  functional  use  of  language  (Padilla  & 
Lindholm,  1984).  Determining  language  proficiency  for  bi lingual 
children  is  difficult  because  fluency  in  a  language  is  dependent 
upon  many  factors  such  as  the  social  context,  the  language 
permitted  or  encouraged  in  that  context,  and  the  topic  of 
conversation  (Duran,  1984).  For  example,  Hispanics  may  use 
Spanish  generally  but  may  be  more  familiar  with  English  as  the 
main  language  of  the  school  (Duran,  1984). 

In  addition  to  the  identification  of  children  needing 
special  English  services,  another ~i ssue  is  the  nature  of  the 
special  instruction  they  receive.  Researchers  disagree  on 
whether  the  focus  of  special  programs  should  be  immersion  in  the 
English  language  in  special  classes,  with  instruction  in  other 
subjects  in  the  usual  classes,  or  bilingual  programs  that  teach 
children  in  their  native  language.  Clear  differences  in  student 
outcomes  in  the  two  types  of  programs  have  not  been  found. 
Although  methodological  problems  preclude  definitive  conclusions, 
some  studies  suggest  that  bilingual  programs  result  in  lower 
drop-ouc  rates  (reported  to  be  as  high  as  90%  for  Hispanics  in  a 
Texas  school  district),  better  attendance,  and  higher  self- 
concepts  (Otheguy,  1982;  Rotberg,  1982).  In  studying  the  effects 
of  different  programs,  other  variables  such  as  socioeconomic 
status,  ethnic  or  national  origin,  and  age  on  arrival  in  the  U.S. 
should  be  included  (Rotberg,  1982;  Steinberg  et  al.,  1984).  In 
addition  to  achievement  as  a  major  outcome  of  bilingual  programs, 
the  preservation  of  the  child's  native  language  may  be  a  desired 
goal  for  many,  although  the  issue  is  controversial  (see  Orteguy, 
1982).  Spanish-English  bilingual  children  in  Head  Start 
bilingual  programs  appear  to  decline  in  complex  Spanish 
linguistic  forms  as  they  increase  in  complex  English  forms 
(Garcia  &  Gonzalez,  1984). 

Identifying  qualified  teacherr*  and  appropriate  curricula 
may  be  a  problem.  For  example,  because  of  the  Title  VII 
(Elementary  and  Secondary  Education  Act,  1974)  ruling  that  20  or 
more  students  from  the  same  language  group  in  a  given  school 
di strict  must  get  special  instruction,  the  Chicago  school 
district  must  provi^de  instruction  in  Spanish  and  17  other 
languages.  A  study  in  New  Mexico  found  that  only  13  of  136 
bilingual  teachers  and  aides  could  read  and  write  Spanish  at  the 
third  grade  level  (Rotberg,  1982). 

Segregation  becomes  an  issue  in  the  education  of  bilingual 
children.  To  av'oid  segregation.  Title  VII  funding  of  bilingual 
programs  allows  up  to  40%  of  the  children  enrolled  to  be  native 
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English-speakers  (Rotberg,  1982).  Hispanic  students  may  be 
assigned  to  bilingual  programs  on  the  basis  of  ethnicity,  or  home 
language  rather  than  on  language  proficiency.  In  a  study  of 
Title  VII  bilingual  programs^  75%  of  the  students  were  Hispanic 
but  less  than  one-third  of  them  were  judged  by  a  teacher  to  be  of 
limited  English  proficiency  (Rotberg,  1982). 

Private  schools.  Many  parents  view  public  schools^  long 
the  backbone  of  American  education,  as  less  desirable  than 
private  schools.  The  expectation  of  higher  achievement  and  of  a 
relatively  homogeneous  student  body  may  lead  some  parents  to 
prefer  private  schools.  A  report  comparing  public  and  private 
schools,  prepared  for  NCES  by  Coleman,  Hoffer,  &  Kilgore  (1981), 
generated  much  controversy  regarding  the  segregation  of  private 
schools,  the  differential  achievement  of  private  and  public 
school  students,  and  the  predicted  effects  of  public  support  of 
private  schools.  Critics  of  the  report  (e.g.,  Braddock,  1981a, 
1981b)  point  out  that  the  finding  of  little  segregation  in 
private  schools  is  meaningless,  because  of  the  miniscule  number 
of  minority  students  in  private  schools.  The  index  of 
segregation  used  in  the  report  was  based  on  the  distribution  of 
Black  and  white  students  within  the  private  school  system,  not  on 
the  proportion  of  Blacks  in  private  schools.  It  assessed  whether 
chose  Blacks  within  the  system  of  private  schools  tend  to  be 
segregated  in  certain  schools.  The  important  issue,  however, 
is  Black  access  to  private  schools,  not  their  segregation  within 
the  private  school  system. 

The  finding  of  higher  achievement  for  private  schools  does 
not  take  into  account  sel f -select ion  artifacts  or  curriculum 
placement  of  public  and  private  school  students.  The  higher 
achievement  found  for  private  school  students  might  be  diminished 
if  they  were  compared  to  public  school  students  in  college 
preparatory  tracks  rather  than  the  entire  public  school 
population   (Braddock,   1981a,  1981b). 

Finally,  the  Coleman  et  al.  claim  that  public  support  of 
private  schools  would  aid  poor  and  minority  students  and  would 
not  lead  to  further  segregation  is  not  supported  (Braddock, 
1981a,  1981b).  The  support  and  improvement  of  public  schools  are 
necessary  for  educationa 1  opportuni ty  for  poor  and  minor i ty 
students.  Public  and  private  school  comparisons  made  by  Coleman 
et  al.  yield  more  useful  information  about  the  characteristics  of 
effective  schools — such  as  emphasis  on  homework,  demanding 
curricula,  demanding  teachers,  and  a  disciplined,  orderly 
env ironment — which  could  be  used  to  improve  public  schools 
(Braddock,    1981a,  1981b). 

The  biennial  su  veys  of  private  schools  should  be  continued 
and  strengthened.  efforts  must  be  made  to  ensure  that  the 
samples  in  private  jhool  surveys  are  representative  and  that 
reports  from  administrators  of  these  schools  are  reliable. 
Because  of  the  lax  regulation  of  private  schools,  data  regarding 
enrollment,  attendance,  achievement,  and  teacher  certification 
may  be  suspect.       Regulations  for  private  schools  vary  by  state. 
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In  North  Carolina,  for  example,  private  schools  are  required  to 
report  only  the  beginning  and  permanent  termination  of  operation 
(North  Carolina  General  Statutes,  1979).  They  are  not  required 
to  hire  certified  teachers.  Participation  in  state  achievement 
testing  and  minimum  competency  testing  programs  is  voluntary, 
although  private  schools  are  required  to  give  a  standardized 
achievement  test  to  students  at  specified  grade  levels  and  a 
standardized  minimum  competency  test  to  eleventh  graders  each 
year.  They  must  maintain  records  of  these  tests,  along  with 
attendance  and  immunization  records,  for  one  year  for  possible 
inspection;  the  appropriate  state  agency  may  or  may  not  inspect 
these  data,  at  its  own  discretion.  The  high-achieving  private 
schools  described  in  the  Coleman  et  al. -study  may  not  be  the 
norm. 


The  stability  of  private  schools --how  long  they  stay  in 
operation —  needs  to  be  monitored,  along  with  patterns  of 
movement  of  students  between  private  and  public  schools. 
Individual  level  data  from  parents  and  students  should  be 
obtained,  particularly  regarding  motives  for  attending  private 
schools  and  perceived  and  actual  benefits  of  private  school 
attendance.  The  motives  and  experiences  of  Blacks  and  other 
minorities  in  private  schools  should  be  assessed,  as  has  been 
done  in  Slaughter's  recent  work  (Slaughter  &  Schneider,  1985; 
Slaughter,   Schneider,   &  Lindsey,   1985)  • 

Some  parents  eschew  formal  schooling  altogether,  choosing 
instead  to  teach  their  children  in  their  homes.  In  North 
Carolina,  a  recent  court  ruling  required  that  these  parents 
comply  only  with  the  minimal  regulations  for  private  schools; 
they  are  not  required  to  report  anything  other  than  the  beginning 
and  the  permanent  closing  of  operation  (Alvarado,  1985).  In  1985, 
at  least  twenty-five  "schools"  with  students  from  two  or  three 
families  were  established  in  North  Carolina.  Officials  expect 
the  number  of  home  schools  to  increase.  A  parent  group  lobbying 
for  home  education  in  North  Carolina  claims  300  families  as 
members  (Perkins,  1985).  More  information  is  needed  on  the 
numbers,  experiences,  and  achievement  of  children  taught  in  their 
own  homes. 


Computers  and  schools.  Changes  in  technology  in  the  society 
affect  schools.  An  increasingly  computerized  society  requires 
that  children  become  computer  functional,  if  not  computer 
literate.  The  National  Commission  on  Excellence  in  Education 
(1983}  recommended  that  computing  be  a  basic  high  school  subject. 
The  extensive  use  of  computers  may  result  in  changes  in 
definitions  of  intelligence  and  education;  education  may  move 
from  basic  facts  to  information  management  skills;  broad  problem- 
solving  skills;  planning,  monitoring,  learning  to  learn,  and 
other  metacogniti ve  skills;  and  communication  and  inquiry  skills 
(Pea,  1985).  Research  on  the  computers*  impact  is  especially 
needed  now,  before  computers  become  so  widespread  that  finding 
children  unfamiliar  with  computers  will  be  difficult  (Lepper, 
1985) . 


ERJC  489 


NCES  has  assessed  the  availability  of  microcomputers  and. of 
terminals  to  mainframes  in  elementary,  junior  high,  and  senior 
high  schools  (Grant  &  Snyder,  1983).  From  1982  to  1$83,  the 
percentage  of  elementary  schools  having  microcomputers  more  than 
tripled,  the  percentage  of  junior  high  schools  more  than  doubled, 
and  the  percentage  of  high  schools  tripled  (Whalen,  1984).  The 
amount  of  time  students  use  computers  was  assessed  in  a  study 
conducted  by  Johns  Hopkins'  Center  for  the  Social  Organization  of 
Schools.  In  elementary  schools,  the  median  number  of  minutes  of 
student  use  per  week  was  low:  12  minutes  for  learning  and 
recreational  games,  13  minutes  for  drills  and  remedial  work,  and 
19  minutes  for  programming  and  computer  literacy;  almost  no 
students  spent  more  than  60  minutes  per  week  using  the  computer. 
The  "biggest  increase  from  elementary  to  secondary  schools  was  in 
programming  and  computer  literacy  (median,  55  minutes)  and  in 
word  processing  and  data  processing  (30  minutes).  These  amounts 
are  not  adequate.  At  least  500  hours  of  computer  time  may  be 
necessary  for  the  development  of  expert  programming  skills  (Linn, 
1985). 

Although  these  surveys  provide  useful  beginning  information 
about  computers  in  schools,  other  issues  must  be  a<?dressed. 
Computer  technology,  in  its  present  transitional  stage,  appears 
to  amplify  existing  social  roles  and  social  problems  (Caporael  & 
Thorngate,  1984).  The  use  of  computers  may  increase  the 
achievement  gaps  between  middle-class  children,  who  are  likely  to 
have  and  u?.e  computers  in  their  homec  as  well  as  in  school,  and 
poor  children,  who  may  have  only  limited  access  to  an  inadequate 
number  of  computers  at  school.  According  to  Linn  (1985),  access 
to  computers  at  home  and  at  school  is  related  to  middle-school 
students'  programming  skills,  except  in  those  classes  labeled 
"exemplary".  In  addition,  boys  appear  to  master  and  enjoy 
computers  more  than  do  girls.  Boys'  greater  affinity  for 
computers  may  result  from  the  preponderance  of  educational 
programs  with  male  sex-typed  themes  such  as  sports,  war,  and 
violence  (Lepper,  1985)  and  from  the  association  of  computers 
with  mathematics  in  junior  and  senior  high  schools  (Sheingold, 
Kane,  &  Entreweit,  1983).  When  girls  take  computer  courses,  they 
may  perform  as  well  as  boys.  In  Linn's  (1985)  research,  girls 
were  37%  of  middle  school  programming  classes  but  60%  of  students 
identified  as  the  most  talented  programmers.  These  trends  that 
could  maintain  or  exacerbate  existing  inequities  need  to  be 
monitored.  Computer-assisted  instruction  may  be  useful  for  poor 
minority  students  in  some  situations,  however.  Sheingold  et  al. 
(1983)  describe  teen-aged  Asian  immigrants,  attending  school  for 
the  first  time,  who  had  successful  experiences  learning 
mathematics  via  computers,  because  little  English  was  required. 

Attention  must  be  given  to  the  actual  use  of  computers  and 
what  students  gain  from  them.  Derek  Bok  of  Harvard  University 
has  suggested  that  computers,  because  they  limit  the  student  to  a 
specified  set  of  responses,  may  restrict  students'  imagination 
(Culliton,  1985).  According  to  Bok,  some  areas  of  study,  such  as 
historical  interpretation  or  literary  criticism,  cannot  be 
reduced  to  the  formal   rules  and  procedures  necessary  for 
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computerized  instruction.  Ideally,  students  should  net  be 
passive,  using  the  computer  only  for  routine  drills;  such 
students  may  guess  randomly  just  to  move  the  program  aloag. 

Although  computer  drills  may  not  be  much  of  an  advancement 
over  workbook  drills,  other  uses  of  the  computer  may  facilitate 
learning  in  unique  ways.  Carefully  designed  tutorial  programs 
may  allow  for  the  redirection  of  students'  learning  according  to 
the  nature  of  their  errors.  Word  processors  may  encourage  the 
development  of  skills  with  written  language,  because  of  the  ease 
of  editing  and  revising  (Wolf,  1985);  computer  simulations  of 
principles  and  experiments  in  the  physical  and_  biological 
sciences  may  help  to  make  abstract  concepts  concrete  and 
understandable  (Chaille  &  Littman,  1985);  computer  graphics  may 
enhance  the  development  of  spatial  ^s kills  (Klein,  1985). 
Lear ni ng  may  be  facilitated  most  when  children  acqui re  the 
control  that  results  from  learning  to  program  the  computer 
(Sheingold,  et  al.,  1983).  Children  who  learn  to  program  may 
acquire  valuable  conceptual  and  problem-solving  skills  that  will 
be  useful  in  other  contexts  (Dickson,  1985;  Lepper,  1985;  Linn, 
1985;  Olson,  1985). 

Research  is  needed  to  determine  whether  computer-assisted 
instruction  actually  enhances  learning  and  achievement. 
Research  should  address  whether  computer-assisted  instruction  in 
a  "f un-and-games"  format  is  more  or  less  effective  than  typical 
"dr i  1 1-and-practice"  computerized  presentations  (Lepper,  1985). 
Research  should  address  whether  programming  skills  actually 
transfer  to  other  problem-solving  situations.  Attention  should 
be  given  to  the  possibility  that  the  computer  may  maintain 
achievement  gaps  between  low  achievers  who  use  them  for  drill 
and  high  achievers  who  learn  to  program. 

Computers  may  change  the  social  dynamics  of  the  classroom. 
Hawkins,  Sheingold,  Gearhart,  &  Berger  (1982)  found  that 
elementary  school  teachers  focus  on  the  social  rather  than  the 
cognitive  outcomes  of  using  computers  in  their  classrooms. 
Contrary  to  what  might  be  expected,  more  social  interaction, 
collaboration,  and  helping  are  observed  among  students  working  on 
computers  than  among  those  working  on  other  tasks.  Dickson 
(1985)  suggests  that  the  potential  for  increased  social 
interaction  in  classroc.r.3  with  computers,  expecial ly  those  with 
"thought-provoking"  software,  may  be  more  significant  than  the 
potential  for  increased  cognitive  skills.  Social  interaction 
related  to  cognitive  tasks  contributes  to  cognitive  development 
(Chaille  &  Littman,  1985). 

The  appropriateness  of  software  and  its  relationship  to  the 
curriculum  should  be  monitored.  Software  may  be  independent  of 
the  curriculum,  it  may  be  chosen  to  reflect  the  existing 
curriculum,  or  it  may  result  in  the  design  of  a  revised 
curriculum  incorporating  the  computer.  Bok  suggests  that  the 
process  of  software  development,  because  it  requires  detailed 
attention  to  the  presentation  of  material  in  a  manner  that 
facilitates  student  learning  and  interest,  may  lead  to  a  more 
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careful  appraisal  of  the  entire  instructional  process  (Culliton, 
1985).  The  use  of  computers  may  also  lead  to  .a  more 
individualized  curriculum  (Lepper,   1985;  Sheingold  et  al.,  1983). 

Teacher  expertise  in  using  computers  needs  to  be  monitored. 
Teachers  may  need  time  to  develop  their  skills  in  the  school 
rather  than  more  formal  courses  (Sheingold  et  al.,  1985).  Some 
teachers  become  "computer  buffs"  on  their  own  initiative  but  the 
active  support  of  the  principal  in  acquiring  time  and  resources 
may  be  critical  (Sheingold  et  al.,  1985).  As  computers  become 
integrated  into  curricula,,  aides  may  be  able  to  manage  students' 
computer  activities  and  teachers  may  focus  on  higher-level 
conceptual  development  and  social  development  (Sheingold  et  al., 
1985).  The  emergence  of  student  computer  experts  in  some  schools 
has  led  to  new  student-teacher  relations,  with  students  sometimes 
contributing  to  the  development  of  teachers'  skills  (Sheingold  et 
a  1 198  5) •  Teache  rs  interacting  with  student -experts  may 
experience  role  conflict  (Caporael  &  Thorngate,  1984)  but  this 
may  be  a  temporary  phenomenon  that  will  disappear  as  computers 
become  more  widely  used  and  the  usual  structure  of  expertise 
resumes  (Sheingold,  Hawkins,   &  Char,  1984). 

Drop-out  rates.  The  rate  at  which  children  leave  school 
without  a  high  school  diploma  needs  to  be  monitored.  The  drop-out 
rate,  or  its  inverse,  the  graduation  rate,  is  considered  an 
important  indicator  of  the  status  of  American  education.  A  major 
perf orir.ance  outcome  in  across-state  comparisons,  the  graduation 
rate  varies  from  a  reported  high  of  94.8%  in  North  Dakota  to  a 
low  of  57.2%  in  Louisiana   (U.S.  Department  of  Education,  1985). 

There  are  discrepancies  between  the  drop-out  rates  estimated 
by  NCES  (27%)  and  by  the  Census  Bureau  (16%)  (Cooke  et  al., 
1985).  The  NCES  measure  is  the  difference  between  the  number  of 
public  high  school  graduates  in  a  given  year  and  the  number  of 
public  school  9th-graders  from  four  years  before;  the  Census 
Bureau,  in  household  surveys,  asks  individuals  how  many  years  of 
school  they  have  completed.  Cooke  et  al.  point  out  a  number  of 
reasons  for  the  possibly  inflated  NCES  measure  and  the  possibly 
too-low  Census  figure.  The  basic  problem,  however,  is  one  of 
definition.  The  Census  measure  is  actually  an  assessment  of  the 
proportion  of  the  population  reporting  that  they  have  completed 
high  school,  including  those  who  pass  high  school  equivalency 
exams.  These  self-report  data  are  not  checked  against  any 
official  data.  The  NCES  statistic,  if  it  excluded  current 
graduates  who  were  not  ninth-graders  four  years  earlier,  would  be 
a  clean  measure  of  the  proportion  of  ninth-graders  who  graduate 
on  schedule.  Follow-up  assessments  could  determine  the  rate  at 
which  the  ninth-graders  graduate  five  or  six  years  later.  This 
assessment  still  would  miss  students  who  left  school  before  ninth 
grade. 

The  High  School  and  Beyond  study  provides  useful  information 
about  drop-outs  from  the  1980  sophomore  class  (Whalen,  1984). 
Data  are  reported  by  sex,  race/ethnicity,  socioeconomic  status, 
grade  and  curriculum,    community  type  and  geographic  region,  and 


480 


public  or  privcte  school.  Most  important,  the  reasons  students 
give  for  dropping  out  are  reported  by  sex  and  race.  Reasons 
cited  most  frequently  were  dislike  of  school  for  white  males, 
poor  grades  for  minority  males,  marriage  and  dislike  of  school 
for  white  females,  and  poor  grades  and  pregnancy  for  minority 
females.  This  kind  of  information  is  critical  for  the  prevention 
of  students'  dropping  out.  In  addition,  distinctions  should  be 
made  between  truancy,  chronic  absenteeism,  and  drop-outs  (Zill  et 
al.,  1984).  Some  students  who  have  not  formally  left  school  may 
be  absent  so  frequently  that  they,  for  all  practical  purposes, 
are  drpp-outs  (Steinberg  et  al,,  1984),  More  inf ormat  ion  on 
drop-outs  in  minority  groups  is  needed.  Drop-out  rates  for 
Hispanics  (40%)  ,and  Amer  ican  Indians  (38-60%)  are  extremel y 
high,  much  greater  than  those  of  Blacks  and  whites  (Steinberg  et 
al.,  1984), 

Tr  ans  i  t i  on  to  wo  r k.  Much  attention  is  given  to  the 
preparation  of  students  for  higher  education,  as  evidenced  by  the 
use  of  the  SAT  and  ACT  in  comparisons  of  educational  outcomes 
across  states  (U.S.  Department  of  Education,  1985).  Many 
students,  however,  want  and  need  to  enter  the  job  market 
immediately  after  high  school.  They  need  to  be  prepared  for  an 
occupation  and  for  forms  of  additional  training  other  than 
college.  The  transition  directly  from  high  school  to  worl<  occurs 
more  often  for  poor  and  minority  students  than  for  middle-class 
and  white  students. 

A  most  serious  dilemma  is  the  relationship  of  the  education 
children  receive  to  the  nature  of  employment  available  to  them  in 
the  society.  Current  evaluations  of  American  education,  such  as 
that  of  the  National  Commission  on  Exce 1 lence  in  Education 
(1983),  suggest  that  the  faltering  American  economy,  both  its 
domestic  and  international  status,  is  the  result  of  our  poor 
educational  system,  or  at  least  can  be  revived  by  improvements  in 
the  educational  system^  Giroux  (1984)  points  out  that  the 
converse  is  true — the  economy  has  a  great  impact  on  the  schools. 
Duckworth  (1984)  cites  Bureau  of  Labor  Statistics  projections  of 
more  fast-food  than  high-technology  jobs  in  1990.  The  increasing 
polarization  of  available  jobs — a  relatively  small  number  of  high 
technology  jobs  and  a  high  number  of  low-le ve  1  service  jobs 
requiring  few  intellectual  skills — raises  difficult  questions 
about  the  economy,  the  educa tiona 1  system,  and  the  comp lex 
relationship  between  the  two   (Giroux,  lSf84). 

Although  some  may  argue  that  a  successful  American  economy 
depends  upon  well-educated,  highly  skilled  adults,  such  may  not 
be  the  case.  If  projections  regarding  avail  able  jobs  are 
accurate,  the  economy  may  need  large  numbers  of  adults  willing  to 
work  in  what  are  presently  low-paying,  unsatisfying  service  jobs. 
Are  we  trying  to  teach  children  skills  they  will  not  be  able  to 
use  as  adults?  If  the  majority  of  children  acquire  high-level 
technical  and  conceptual  skills,  how  will  the  society  decide  who 
gets  the  more  lucrative,  prestigious  high-tech  jobs  and  who  gets 
the  service  jobs?  Does  the  achievement  of  poor  minorities  remain 
low  because  of   perceptions  of   a   "job  ceiling"   (Ogbu,  1978)? 
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These  questions  regarding  the  utility  and  promise  of  the 
educational  system  for  all  of  America's  youth  must  be  answered. 
A  continuation  and  strengthening  of  the  assessment  of  students' 
activities  after  high  school  is  necessary.  The  nature  of 
employment,  as  well  as  the  rate  of  employment,  should  be 
assessed  • 

Childhood  development 

Longi  tudinga 1  studies*  Because  schools  provide  a  major 
context  for  children's  development,  much  more  information  is 
needed  on  children's  experiences  in  school,  in  addition  to  the 
outcomes  of  schooling.  A  nat' ona  1  longi  tudina  1  survey  of 
children  in  the  elementary  grades,  similar  to  the  longitudinal 
surveys  focusing  on  secondary  schools,  has  been  proposed  (Zill  et 
al.,  1984).  Such  a  survey  should  include  children  and  parents  as 
respondents  in  addition  to  gathering  information  about  classroom 
processes.  Students'  attitudes  toward  school  and  achievement 
aspirations  and  expectations  should  be  assessed.  The  relative 
inattention  to  elementary  school*  children  in  national 
longitudinal  studies  is  not  in  keeping  with  the  importance  of 
development  during  this  time  of  children's  lives, 

Preprimary  school ing.  Because  of  dramatic  changes  in  family 
structures"^  one  cannot  assume  that  most  school  children  li^e  in 
homes  with  a  father  who  is  the  sole  breadwinner  and  a  mother  who 
is  a  full-time  homemaker.  More  than  half  of  women  with  children 
work  outside  the  home  and  a  high  proportion  of  children  live  with 
a  single  parent,  usually  the  mother,  for  at  least  a  portion  of 
their  lives.  Minority  children  are  more  likely  than  white 
children  to  live  in  single-parent  homes.  These  changing  family 
structures  have  implications  for  after-school  programs,  and  for 
day  care  services  as  part  of  public  schools.  The  proportion  of  ?- 
and  4-year-olds  enrolled  in  some  form  of  schooling  almost 
quadrupled  between  1964  and  1983,  rising  from  9,5%  to  37,5%  (NCES 
Indicators,  1985),  The  educational  experiences  of  3-  and  4- 
year-old  children  will  continue  to  be  an  important  issue.  The 
survey  of  prekindergarten  enrol  Imen t,  conducted  through  the 
Census*  Current  Population  Survey,  should  be  continued,  A 
related  issue  is  the  before-  and  after-school  care  of  children  of 
working  parents,  which  often  is  handled  by  the  same  providers  who 
take  car^  of  3-  and  4-year-olds,  Lack  of  appropriate  care  has 
resulted  in  the  problem  of  "latch-key"  children. 

Although  day  care  facilities  that  have  been  studied  appear 
to  cause  neither  increases  nor  decreases  in  educational 
achievement  for  children  generally  (Belsky  &  Steinberg,  1978), 
longitudinal  research  shows  positive  educational  and  economic 
outcomes  for  children,  mostly  poor  and  minority,  who  participate 
in  special ly  designed  prekindergarten  programs  (Lazar  & 
Darlington,  1982),  The  quality  of  present  day  care  facilities 
is  an  issue  of  concern;  some  facilities  are  exemplary  but  others 
are  merely  custodial  and  some  have  allowed  the  abuse  of  children 
enrolled.  The  cost  as  well  as  the  availability  of  quality  care  is 
an  issue;    many  parents,  especially  single  mothers,  simply  cannot 
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afford  good  day  care. 

Some  European  and  Asian  countries  presently  provide 
educational  programs  supported  by  public  funds  for  3-  and  4-'year- 
olds.  In  the  United  States,  some  states  have  public  programs, 
which  typically  are  half-day  programs  and  are  not  available  to 
all  3-  and  4-year-old  children;  other  states  are  planning 
programs  for  1985-86  and  some  are  studying  the  need  for  and 
feasibility  of  such  programs.  North  Carol ina,  for  example, 
recently  completed  a  study  of  the  issue  (Kahdy,  1985).  They 
concluded  that  the  public  school  does  have  a  responsibility  to 
provide  programs  for  prekindergar ten  children  because  of  the 
developmental  needs  of  children  of  that  age  group  and  because  of 
the  needs  of  working  parents.  The  most  vigorous  objection  to 
public  prekindergarten  programs  came  from  private  day-care 
providers,  with  some  concern  a Iso  expressed  by  those  who  feared 
that  structured  programs  and  pressure  for  academic  success  would 
overburden  children. 

In  analyzing  and  reporting  prekindergarten  enrollment 
data,  emphasis  should  be  given  to  differential  enrollment  rates 
of  minority  groups.  *  In  1981,  approximately  36%  of  both  Black  and 
whi te  3-  and  4-year-olds  were  enroll ed  in  school  programs, 
compared  to  approximately  25%  of  Hispanic  children  (Grant  and 
Snyder,  1983).  Trends  in  private  and  public  enrollment  should  be 
monitored  for  white  and  minority  groups.  In  1982,  61%  of  3-  and 
4-year-olds  enrolled  in  school  were  in  private  programs.  More 
than  70%  of  white  but  only  33%  of  Black  children  enrolled  in 
school  were  in  private  programs  (Kahdy,  1985).  The  high  cost  of 
good  private  day  care  may  mean  that  poor  children  are  denied 
access  to  quality  educational  experiences.  These  programs  may  be 
the  beginning  of  segregated  education  for  Black  and  white 
children,  and  for  poor  and  affluent  children.  The  provision  of 
public  programs  for  only  poor  children,  however,  will  further 
institutionalize  the  segregation  and  unequal  experiences  of 
children  of  this  age  group.  The  adequacy  of  federal  funds  for 
poor  chi Idren  shou Id  be  monitored.  Federal  Title  XX  and  Head 
Start  provide  programs  for  only  20%  of  eligible  children  (Kahdy, 
1985)  . 

The  reporting  of  data  on  3-  and  4-year-old  enrollment  should 
be  in  the  most  useful  form.  For  example,  3-  and  4-year-old 
enrollment  combined  with  5-year-old  enrollment  is  misleading 
because  almost  100%  of  5-year-olds  are  in  some  school  program. 
Another  problem  is  that  no  distinction  is  made  between  half-day 
and  full-day  programs  in  tha  reports. 

The  cost  of  programs  and  the  certification  of  teachers  for 
this  age  group  should  be  assessed.  Day  care  workers  generally 
earn  less  than  public  school  teachers,  have  less  formal 
education,  and  are  not  certified.  On  the  other  hand,  public 
prekindergarten  programs  may  be  cost-effective  if  they  employ 
unused  or  underused  facilities  and  resources,  and  if  existing 
services  in  the  public  schools,  such  as  those  related  to 
counseling,   testing,  and  health,  can  accommodate  prekindergarten 


children.  The   instructional   quality   of  programs   should  be 

assessed,  especially  the  degree  of  structure  of  the  curricuLunii 
the  nature  of  evaluation  of  students,  and  the  attention  given  to 
social,  emotional,  and  physical  as  well  as  cognitive  development. 
The  extent  of  before-  and  after-school  programs  in  public  and 
private  institutions  should  be  assessed,  including  the  quality  of 
children's  experiences  m  those  settings.  The  attitudes  of  the 
public,  including  private  day-care  providers,  toward  public 
prekindergar ten  programs  should  be  assessed. 

Adolescent  development.  Longitudinal  studies  of  high  school 
students  should  be  continued.  As  adolescents  become  increasingly 
independent  and  begin  to  make  decisions  for  themselves  that  may 
affect  their  school  performance  and  their  adult  life  chances, 
attention  must  be  given  to  the  special  problems  that  arise.  One 
is  the  relation  of  athletics  to  academic  performance.  Much 
attention  has  been  given  to  young  men,  in  particular,  who  are 
superb  athletes  in  high  school  and  later  in  college  but  whose 
academic  skills  are  woefully  lacking.  School  districts  try  to 
handle  this  situation  by  maintaining  minimum  academic  standards 
for  participation  in  athletic  activities  and  other 
extracurricular  activities.  The  athletics/academics  problem 
appears  to  affect  minority  students  more  than  whites.  Career 
guidance  in  general  is  an  important  issue  for  Black  males  (Perry 
(i:  Locke,  1985). 

An  additional  problem  of  teenage  students  is  alcohol  and 
drug  abuse.  For  example,  a  northern  New  Jersey  school  district 
recently  established  a  policy  requiring  students  to  take  a 
physical  examination  yearly,  which  includes  tests  for  illegal 
drugs.  Such  extreme  measures  are  controversial  but  reflect  the 
concern  with  schools  as  places  for  drug  use  and  drug  trafficking. 
A  related  issue  is  violence  in  schools.  Schools  must  have  an 
atmosphere  of  safety  rather  than  fear  in  order  for  teaching  and 
learning  to  proceed  smoothly.  Cooke  et  al.  (1985)  point  out 
problems  in  accurately  assessing  the  incidence  of  student 
victimization. 

The  high  incidence  of  pregnancy  among  adolescents  is  an 
issue  for  schools.  Some  schools  provide  sex  education  programs 
aimed  at  pregnancy  prevention  but,  again,  these  are 
controversial.  Many  parents  disapprove  of  the  school's  providing 
information  about  an  aspect  of  chi Idren's  1 i ves  that  involves 
personal  values.  A  1982  survey  found  that  80%  of  approximately 
200  urban  school  districts  provided  sex  education  but  only  16%  of 
senior  high  and  11%  of  junior  high  schools  offered  separate 
courses  (Sonenstein  &  Pittman,  1984).  Fewer  than  10%  of  students 
attend  formal  programs  of  more  than  40  hours  (Kirby,  1984).  Teen 
pregnancy  has  implications  for  the  drop-out  rate  and  may  require 
school  districts  to  provide  special  programs  or  schools  for  the 
pregnant  teen.  Among  white  females  who  dropped  out  of  the 
sophomore  class  of  1380,  the  most  frequently  cited  reason  for 
leaving  school  (36.4%)  was  marriage  or  plans  for  marriage,  which 
could  have  involved  a  pregnancy.  Pregnancy  was  cited  as  a  reason 
by  20.5%  of  white  girls.     For  minority  girls,  the  most  frequently 
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cited  reason  was  poor  grades  (30%)  but  pregnancy  was  a  close 
second  (29.2^).  Marriage  or  plans  for  marriage  was  cited  by 
19.2%. 

Qual i ty  of  instruction 

Teacher  preparation.  The  competence  of  teachers  must  be 
monitored  in  a  more  precise  manner  than  merely  assessing  years  of 
education  or  experience,  although  certainly  those  pieces  of  data 
should  be  collected.  Much  concern  has  been  expressed  regarding 
teachers'  academic  ability  and  the  quality  of  courses  they  choose 
in  college.  In  1982,  high  school  seniors  planning  to  become 
teachers  earned  a  low  mean  SAT  score,  ranking  26  out  of  29 
planned  majors.  College  graduates  who  enter  and  plan  to  remain 
in  the  teaching  profession  are  among  the  lowest  scorers  on  the 
SAT  (NCES  Indicators,  1985).  The  Southern  Regijnal  Education 
Board's  examination  of  transcripts  of  198  2-83  graduates  of 
seventeen  Southern  universities  revealed  teachers  take  65%  more 
education  methods  courses  than  needed  for  certification,  only  22% 
of  their  math  courses  are  college-level,  75%  take  no  foreign 
language  and  no  philosophy  courses,  66%  take  no  chemistry  and  no 
physics,  and  83%  take  no  upper-level  English  courses  (Galambos, 
198b).  Proposals  to  change  the  structure  of  teacher  education 
have  been  made,  such  as  having  a  more  comprehensive  undergraduate 
education  and  professional  teacher  training  ac  the  master's  and 
doctoral  levels.  The  specific  structure  of  teachers'  education 
needs  to  be  monitored. 

Teacher  pay  must  be  monitored.  Teacher  salaries,  adjusted 
for  inflation,  have  declined  from  the  1970's  until  the  present 
(Weinberg,  Gerald,  &  Tron,  1984).  Male  teachers'  income  is 
considerably  less  than  the  mean  for  all  salaried  professionals, 
although  the  comparable  difference  for  female  teachers  is  not 
nearly  as  great.  In  the  two  decades  between  1961  and  1981,  the 
adjusted  mean  salary  for  all  full-time  male  workers  rose  19%  and 
for  females  rose  17%.  In  contrast,  male  teachers'  adjusted 
salary  rose  only  2%  and  female  teachers'  slightly  more  than  1%. 
The  prospect  of  low  pay  may  discourage  many  talented  college 
students  from  pursuing  teaching  as  a  career.  Some  efforts  to 
remedy  this  situation  have  focused  on  strategies  such  as  merit 
pay  rather  than  across-the-br ard  increases. 

Not  a  new  remedy,  merit  pay  for  teachers  was  tried  in  the 
1920s  and  again  in  the  1960s;  the  programs  instituted  were  short- 
lived (Johnson,  1984).  In  the  present  context  of  overall  low 
teacher  salaries,  some  educators  view  merit  pay  as  impractical, 
divisive,  and  potentially  unfair  (Barranco,  1984).  Although 
proponents  of  mer  i  t  pay  argue  that  all  occupations  reward 
extraordinary  performance,  merit  pay  actually  is  not  used 
extensively  in  industry  and  is  most  effective  in  occupations, 
such  as  sales,  that  rely  on  individual  effort  and  have  clearly 
identified  standards  for  success  (Johnson,  1984).  In  contrast, 
effective  teaching  is  poorly  defined  and  depends  on  factors  the 
teacher  cannot  control,  such  as  the  skills  of  administrators  and 
of  students'  previous  teachers   (Johnson,    1984).   Duckworth  (1984) 


points  out  that  the  relation  of  beginning  to  maximum  salaries  for 
teachers  is  not  much  different  from  that  of  other  salaried  ( 
professionals,  such  as  engineers;  the  striking  difference  is  the 
overall  low  level  of  teachers'  pay.  A  Boston  public  school 
administrator  (Rosen,  1984),  however,  concluded  that  merely 
raising  teacher  salaries  will  not  result  in  improved  education, 
because  Boston  teachers  have  high  salaries,  relative  to  teachers 
nationwide,  and  their  students  very  low  achievement  scores. 
Perhaps  salary  increases  must  be  combined  with  other  improvements 
in  working  conditions  to  affect  teacher  performance. 

The  supply  of  qualified  teachers  needs  to  be  monitored  and 
the  racial/ethnic  composition  of  the  teacher  pool  needs  to  be 
monitored.  In  addition,  demand  for  teachers  needs  to  be 
accurately  monitored  so  that  efforts  can  be  made  to  match  supply 
with  demand.  The  number  of  positions  vacant  can  be  underestimated 
if  a  program  is  terminated  because  of  no  teachers;  no  vacant  or 
unfilled  positions  would  appear  because  the  entire  program  was 
terminated. 

Classroom  processes.  The  amount  of  time  during  the  school 
day  actually  spent  fn  instruction--time  on  task--has  been 
conceptualized  as  a  major  variable  of  importance  in  students' 
achievement  but  no  national  data  on  this  hard-to-measure  variable 
.are  available  (Cooke  et  al.,  1985).  Another  important  time 
variable,  the  proportion  of  students  who  attend  school  daily  may 
not  be  accurate  because  states  may  compute  attendance  in 
different  ways,  and  may  even  count  students  who  have  excused  ^ 
absences  as  present  (Cooke  et  ax.,  1985).  A  third  time  variable, 
course  enrollment,  also  may  be  inrccurate,  especially  if  reported 
by  students  themselves  (Cooke  et  al.,  1985).  Other  time 
variables  that  need  to  be  assessed  are  length  of  school  day  and 
school  year,  as  some  districts  hava  experimented  with  this  method 
of  increasing  instructional  time. 

Some  educators  (e.g.,  Barranco,  1984)  point  out  that  a  more 
important  issue  is  the  quality  of  instructional  time.  The 
quality  of  instruction  is  even  more  difficult  to  measure  than  the 
time  variables*  Sirotnik  (19b3)  found  that  teaching  practices 
are  remarkably  similar  across  many  elementary  and  secondary 
classrooms  and  are  not  substantially  different  from  those 
employed  throughout  this  century.  These  practices  consist  of 
teachers  lecturing  or  students  working  on  written  assignments  for 
the  majority  of  class  time.  Questions  typically  were  closed  and 
factual,  with  little  feedback  or  guidance.  According  to 
Sirotnik,  the  teaching  practices  supported  dependence  on 
authority,  apathy,  and  passivity. 

The  nature  of  the  interactions  between  teachers  and  students 
need  to  be  monitored.  Data  suggest  that  teachers  respond 
differently  to  minority  and  white  children,  to  poor  and  middle- 
class  children,  to  male  and  female  children  (see  Lockheed,  1985). 
Differential  interactions  may  affect  the  performance  of  children. 
The  means  by  which  teachers  maintain  order  and  discipline  in 
classrooms  should  be  monitored.     A  number  of  organizations,  such 
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as  the  American  Medical  Association,  have  issued  formal 
statements  opposing  the  use  of  corporal  punishment  in  schools; 
four  states  have  outlawed  corporal  punishment  in  schools. 
Suspending  and  expelling  students  from  schools  as  disciplinary 
measures  should  also  be  monitored,  especially  among  minority 
males,  who  are  disproportionately  subjected  to  these  forms  of 
punishmento 

Publ ic  perceptions  of  education 

Assessments  of  the  views  of  parents  and  other  citizens 
regarding  education  need  to  be  continued  and  strengthened. 
Recently,  Phi  Delta  Kappa  established  a  National  Commission  on 
Publ ic  Confidence  in  Education.  In  1970  and  each  year  since 
then,  a  Gallup  survey  of  public  perceptions  of  schools,  sponsored 
by  Phi  De  1  ta  Kappa,  has  been  conducted.  Al  though  the  198  4 
results  (Gallup,  1984;  NCES  Indicators,  1985)  are  hailed  as 
demonstrating  a  sharp  upturn  in  public  opinion  regarding  schools, 
fewer  than  half  of  the  1984  respondents  believed  that  the  schools 
deserved  a  grade  of  A  or  B.  The  mean  grade  given  schools  in  1984 
was  slightly  higher  in  1984,  but  at  2.36  (with  2  representing  C) , 
compared  to  2.12  in  1983,  the  claim  of  a  sharp  increase  is  hardly 
justified.  Asking  individuals  what  grade  they  would  give  their 
local  schools  may  not  be  the  most  meaningful  way  to  assess  public 
opinion.  The  meanings  attached  to  grades  probably  vary  widely 
among  individual?.  Some  may  think  that  "C"  is  a  good  grade; 
others  may  believe  it  is  a  terrible  grade. 

The  views  of  teachers  and  school  administrators  need  to  be 
assessed  separat'^ly  from  those  of  parents.  The  1984  survey  of 
teachers  conducted  by  Louis  Harris  Associates  (NCES  Indicators, 
1985)  found  that  teachers  viewed  student  lack  of  interest, 
inadequate  finances,  and  overcijowded  classrooms  as  more  serious 
problems  than  student  discipline  and  drugs,  the  problems  most 
frequently  cited  by  parents  in  the  1984  Gallup  Poll.  A 
substantial  number  of  teachers,  however,  viewed  discipline  (40%) 
and  drugs  (33%)  as  problems.  The  views  of  those  with  special 
needs  or  concerns  vis-a-vis  the  school  might  also  be  assessed 
separately.  Parents  of  handicapped  children,  gifted  children,  or 
learning  disabled  children  may  have  different  views  of  schools, 
as  may  minority  and  poor  parents. 


Summary. 

National  statistics  should  reflect  the  educational  goals  of 
the  society,  which  are  many  and  varied.  The  clear  identification 
of  major  educational  goals  must  be  followed  by  careful 
operationalization  of  variables,  uniform,  commonly  understood 
definitions,  appropr  iate  sampl ing  techniques,  and  accurate 
reporting  with  checks  for  accuracy.  Variables  studied  should  be 
those  that  are  most  meaningful  rather  than  merely  those  that  are 
most  easily  quantified.  More  information  is  needed  on  the 
processes  of  schooling — what  children  actually  experience — as 
well  as  on  the  outcomes  of  schooling.  Research  efforts  of 
individuals  and  agencies    should  be  coordinated  as  much  as  is 
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possible.     Specific  needs  include: 

!•  Measures  of  educational  achievement  that  reflect  the 
goals  of  the  educational  system* 

2.  Careful  assessment  and  reporting  of  the  educational 
experiences  and  achievement  of  underserved  groups,  including 
rainority,  poor,  female,  and  handicapped  students.  Periodic 
special  reports  and  oversampling  of  these  groups  may  be  required. 

3.  Assessment  of  bilingual  programs,  including 
appropriateness  of  criteria  for  inclusion;  impact  on  achievement, 
retention  of  native  language,  and  segregation;  and 
appropriateness  of  teachers  and  curricula, 

*  4.  Assessment  of  private  schools,  including  minority 
access,  achievement,  quality  of  curricula,  teacher  certification, 
and  public  support. 

5.  Assessment  of  computer  use,  including  impact  on  learning 
and  thinking,  on  curriculum  and  classroom  processes,  and  on 
existing  achievement  gaps  between  various  demographic  groups. 

6.  Accurate  assessment  of  the  drop-out  problem,  including 
rates  for  various  demographic  groups,  students'  reasons  for 
leaving  school,  and  students'  activities  after  leaving  school. 

7.  Assessment  of  students'  work  experiences  after  high 
school,  with  attention  to  the  nature  and  requirements  of 
projected  jobs. 

8.  Longitudinal  studies  of  both  elementary  and  secondary 
students,  including  achievement  but  also  focusing  on-children  as 
respondents  regarding  their  own  experiences  and  perceptions,  and 
including  problems  in  adolescence,  such  as  pregnancy  and  drag 
abuse. 

9.  Careful  assessment  of  public  and  private  programs  for  3- 
and  4-year-olds,  including  cost,  curricula,  teacher 
qualifications,  length  of  school  day,  achievement,  and  enrollment 
of  minority  and  poor  children. 

10.  Assessment  of  teacher  preparation,  teacher  pay,  and 
teacher  demand  in  various  subject  areas. 

11.  Assessment  of  classroom  processes,  including 
instructional  time  variables,  teacher-student  and  student-student 
interaction,   and  measures  of  quality  of  instruction. 

12.  Meaningful  assessments  of  perceptions  of  parents, 
teachers,  and  other  citizens  of  the  educational  system,  including 
the  perceptions  of  parents  of  children  with  special  needs. 

Many  of  the  pr:>blems  of  schools  go  beyond  individual 
achievement,   reflecting  the  developmental  needs  of  children  and 
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the  economic,   political,   and  cultural  conditions  of  American 
(  society.      It   is   not   sufficient   to   igiiorc    issues    larger  than 

cognitive  skills,  using  the  defense  that  schools  .are  not 
responsible.  Whether  the  influence  is  intentional  or  not, 
schools  affect  children's  overall  development.  And,  intentional 
or  not,  the  school  is  an  arena  in  which  the  race/ethnicity, 
class,  and  gender  biases  extant  in  the  larger  society  are  played 
out.  A  critical  issue  for .American  education  is  whether  schools 
can  help  all  children  develop  into  adults  who  have  productive, 
personally  satisfying  roles  in  American  society  or  whether 
schools  will  sort  poor,  minority,  and  female  children  into  the 
roles  traditionally  allowed  for  them. 
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When  the  National  Commission  on  Excellence  in  Education  prepared 
its  report,  A  Nation  At  Risk,  it  was  concerned  very  much  with 
educational  indicators.    The  Commission  was  charged,  in  part,  with 
determining  the  nature  of  the  major  problems  facing  American 
education.    To  do  this,  the  Commission  needed  to  examine  the  evidence 
that  was  availcd^le  of  the  health  of  the  country's  educational  system. 
The  products  of  this  effort  are  two  sections  in  particular  in  A  Nation 
At  Risk;    a  section  called  "Indicators  of  the  Risk,"  which  is  a 
compendium  of  the  major  pieces  of  evidence  the  Commission  found 
concerning  the  quality  of  American  education;  and  sections  of 
••Findings"  in  the  areas  under  which  the  Commission  organized  its 
analysis  and  recommendations — time*  content,  expectation^/  teaching, 
and  leadership. 

The  figures  ciced  in  these  sections  encompass  student  achievement 
in  basic  skills  and  academic  subjects,  rates  of  functional  illiteracy, 
trends  in  the  amount  of  homework  assigned  to  students/  figures  on 
average  teacher  salaries/  comparisons  of  the  time  spent  in  school  by 
U.S.  students  with  the  time  spent  by  their  counterparts  in  other 
countries/  and  so  on,  bnt  the  Commission's  experience  revealed  perhaps 
as  much  about  the  inadequacy  of  our  educational  indicators  as  it  did 
about  the  inadequacy  of  our  educational  programs.    The  "Findings"  and 
"Indicators  of  the  Risk**  cited  by  the  Commission  were  the  best 
evidence  available  on  important  aspects  of  our  educational  system,  but 
there  was  much  more  information  that  should  have  been  included  in 
these  sections  that  simply  was  not  available.    The  Commission  could 
say  nothing,  for  exan^le,  ahout  the  general  skill  of  American  teachers 
in  presenting  subject  matter  and  conducting  lessons.    No  figures  were 
available  to  indicate  whether  functional  illiteracy  was  increasing  or 
wecreasing  over  time.    Comparisons  of  the  achievement  of  U.S.  students 
with  that  of  students  in  otb«r  countries  was  fifteen  years  old  for 
some  subject  areas.    Finally/  detailed  information  about  what  high 
school  students  actually  studied  and  knew  in  subjects  like  science/ 
social  studies/  mathematics/  literature/  and  the  humanities  had  never 
been  collected  or  reported  on  a  nationally-representative  sample. 

At  least  one  indicator — the  courses  typically  taken  by  high 
school  students  during  their  four  years  in  high  school — was  felt  to  be 
so  important  that  the  Commission  arranged  for  its  collection/  having 
found  it  was  not  available  from  any  other  source.    The  resulting 


study  revealed  that  students  took  aiariaincjiy  rev  courses  in  cr.c 
acaaeiTiic  subjects.    This  finaing  lea  the  Comrnissicii  to  recc;iij»;end  tnat 
a  ninimuin  number  of  courses  be  required  in  the  acaderaic  "basics"  — 
English/  science,  social  studies,  and  mathematics/  as  well  as  computer 
science  and  (for  the  college  bound)  foreign  languages — in  order  for 
students  to  be  grcuited  high  school  diplomas,  and  over  the  past  3  or  4 
years,  most  states  have  increased  these  course  requirements.  This 
experience  underscores  the  ir.portance  of  this  mforr.ation,  a  level  of 
importance  which  is  not.  consistent  v/ith  the  inattention  that  this 
particular  piece  of  information  has  been  given  among  our  educational 
data-collection  activities. 

Significant  efforts  are  underway  to  improve  our  educational 
indicators.    The  Department  of  Education  initiated  an  "indicators" 
project  that  has,  thus  far,  provided  a  useful  taxonomy  for  educational 
indicators  and  a  description  or  compendixim  of  twenty  of  the  key 
indicators  in  this  taxonomy  that  are  currently  availcible.    A  periodic 
report  of  these  key  indicators  was  initiated  by  NCES  in  1985. 
(Indicators,  1985)    The  Department  also  initiated  a  one-sheet  chart 
displaying  key  educational  information  for  each  of  the  states.  (U.S. 
Department  of  Education,  1984,  1985)    The  Chief  State  School  Officers 
as  a  group  have  endorsed  (and  taken  the  initiative  for  compiling) 
educational  assessment  data,  including  school  outcome  data,  on  a 
state-by-state  basis,  and  the  National  Assessment  of  Educational 
Progress  has  teJcen  steps  to  enable  states  to  piggy-back  on  the 
National  Assessment  to  collect  state-by-state  achievement  data  for 
purposes  of  self -monitoring  eoid  comparison. 

Despite  these  efforts,  a  crucial  step  remains  to  be  taken.  This 
step  is  to  consider  systematically  the  information  that  we  need  but  do 
not  have  about  education,  identifying  eaid  planning  those  indicators 
that  should  be  added  to,  or  improved  among,  our  current  set. 

What  I  will  attempt  to  do  in  the  remainder  of  this  paper  is  to 
establish  a  framework  for  organizing  and  considering  educational 
indicators,  review  which  of  the  indicators  in  this  framework  are 
currently  available,  and  identify  some  of  the  Important  indicators 
that;  based  on  the  experience  of  tht.  Commission  on  Excellence,  are  not 
available* 

A  Framework  for  Educational  Indicators 

The  concept  of  an  educational  indicator  involves  two  elements. 
Each  of  these  has  been  addressed  by  other  amalysts,  but  they  have  rot 
generally  been  considered  together.    First,  an  indicator  describes  a 
vairiable  in  the  educational  system  or  educational  process.  The 
National  Commission  on  Excellence  in  Education  organized  these 
variables  under  an  input-output  model,  with  an  emphasis  on  the  inputs 
of  education: 
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Figure  1 


Framework  for  Variables  in  Education  Used  Ey 
The  Karional  Corinission  on  Excellence  in  Education'' 
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*The  variables  shown  are  intended  to  illustrate  the  categories  in  this 
framework;  they  are  not  necessarily  all  of  the  variables  considered  by 
NC££. 
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1*1     Eaucacion  Departrient's  Indicators  Project  uses  a  siL-ilar 
scheme,  describing  education  as  a  process,  but  it  classifies  the 
indicators  under  "outcor.es,"  "resources,"  and  the  "context  of 
education,"  or  those  factors  such  as  instructional  climate  and  parent 
support  that  have  an  effect  on  tiit.  success  of  the  educational  process. 

These  schemes  are  alternatives  that  attempt  to  serve  the  same 
purpose:    to  model  the  educational  process  or  system.    One  must  decide 
if  the  models  are  interchangeable  or  whether  they  differ,  and,  if  they 
differ,  whether  on ^  of  them  is  more  valid,  comprehensive,  or 
parsiiiionious  than  the  others. 

The  second  element  involved  in  the  idea  of  an  educational 
indicator  is  the  purpose  to  which  the  indicator  is  applied  (Selden, 
1984;  and  Smith,  1984).    As  we  have  pointea  out,  indicators  can  te 
compared  to  absolute  standards  of  how  we  want  the  educational  system 
to  perform.  They  can  be  used  to  compare  the  performance  of  our  system 
with  th-^  performance  of  other  systems.    Or,  they  Ccin  be  used  to  see 
how  our  system  is  doing  in  relation  to  how  it  has  performed  in  the 
past.    The  Commission  looked  at  evidence  of  the  quality  of  American 
educatiion  by  comparing  it  in  some  cases  to  absolute  standards  (23 
million  illiterate  adults  is  more  than  we  should  accept  in  this 
society);  by  comparing  it  with  similar  evidence  pertaining  to 
education  in  other  countries  (twelfth  graders  in  the  U.S.  do  fair  to 
poorly  in  mathematics  when  ranked  among  twelfth  graders  from  developed 
countries) ;  or  by  comparing  it  with  evidence  of  how  we  have  done  m 
the  past  (17-year-olds  are  less  able  to  draw  inferences  from  their 
reading  now  than  they  were  in  1970) .    These  are  the  three  major  types, 
of  analysis  that  can  be  made  with  an  educational  indicator. 

Smith  explains  these  functions  quite  ably  and  how  they  turn 
simple  variables  about  education  into  indicators  which  are  useful  for 
setting  policy.    He  also  points  out  that  indicators  can  be  analyzed  in 
conjunction  with  one  euxother  to  explore  how  the  educational  system 
works  (and  how  policy  decisions  might  affect  it).    For  example,  while 
the  aptitude  of  students  entering  teacher-preparation  programs  has 
declined,  so  have  average  teacher  salaries,  in  real  dollaurs, 
suggerting  that  there  may  be  a  relationship  between  these  trends. 

Given  these  two  notions  essential  to  the  concept  of  an 
educational  indicator  (the  features  of  the  educational  system  that 
they  describe ,  and  the  purposes  for  which  they  axe  examined) ,  one  is 
tempted  to  array  indicators  in  a  matrix: 
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Matr-x  of  Eaucaticnal  Variables  and 
The  Purposes  to  Which  They  Can  be  Put  As  Indicators 


EDUCATIONAL  SYSTEM 
 Inputs  Outputs  

PURPOSES 


Comparison  with 
a  standard  XXX      -  XXX 

Comparison  with 
another  system  XXX  XXX 

Comparison  with 
past  performance  XXX  XXX 

Analysis  of  how 
the  system  works  XXX  XXX 
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In  this  natrix,  each  characteristic  of  the  eaucacional  system 
could  be  reviewed  for  any  o*-  all  of  the  four  purposes  shown,  and  any 
type  of  ccmparison  or  analysis  ccuia  be  made  cn  any  of  the 
characteristics  of  the  system.     In  real  practice,  it  would  not  be 
useful  or  appropriate  to  make  all  of  these  analyses.    Soce  of  the 
inputs  and  outputs  of  the  educational  system  have  no  inherent, 
absolute  standards  associated  with  them,  or  they  may  have  no  standard 
to  which  we  would  all  agree.     In  these  cases,  reference  to  other 
systems  or  to  past  pei-Tormance  may  be  the  only  reasonable  basis  for 
interpreting  the  indicator.    Exampler  of  this  situation  might  be 
indicators  of  the  abiliry  of  teachers  to  present  lessons  before  a 
classroom/  or  the  fiscal  effort  communities  put  forth  to  pay  for  their 
schools.     In  these  cases,  we  really  have  no  basis  for  deciding  the 
level  on  the  indicator  that  is  desireable  or  acceptable.     In  other 
cases,  we  may  have  set  absolute  goals  for  the  U.S.  educational  system 
that  are  one-time  efforts,  or  that  are  unique  to  the  U.S.  system  and 
do  not  pertain  to  other  systems,  such  as  extending  education  to  the 
disadvantaged  over  a  certain  period  of  time.    In  these  cases,  we  would 
concentrate  on  our  attainment  of  the  goal  and  would  not  (perhaps  could 
not)  review  progress  in  relation  to  past  performance  or  to  other 
countries. 

With  these  caveats  in  mind,  one  can  imagine  a  list  of  variables, 
and  purposes  to  which  they  can  be  interpreted,  that  would  constitute  a 
comprehensive  and  "idealized"  list  of  educational  indicators.  The 
question  before  us  is:    Among  the  most  important  indicators  in  such  a 
list,  which  ones  are  available  to  us  and  which  ones  are  not?  { 


Educational  Indicators — What  Do  We  Know  and  Not  Know? 

The  experience  of  the  National  Commission  on  Excellence  in 
Education  gives  us  a  basis  for  identifying  a  preliminary  set  of  some 
of  the  indicators  that  would  be  useful  to  policy  makers,  and  that  are 
not  now  availcible.    To  do  this,  let  us  go  through  the  taxonomy  of 
indicators  that  tlie  Commission  considered,  to  identify  at  least  some 
of  the  analyses  that  I  feel  the  Commission  was  not  able  to  make, 
because  the  necessary  data  did  not  seem  to  be  avitilable  or  useful. 


1.  Time — The  amount  of  time  allocted  to  education,  and  the  use  of  the 
.time  allocated  by  teachers  and  students. 

What  the  Commission  reported  concerning  time; 

^  That,  in  the  U.S.,  the  typical  school  year  is  180  days  and  the 
typical  high  school  day  is  6  hours,  compared  with  England  and  other 
industrialized  countries,  where  it  is  not  unusual  for  high  school 
students  to  spend  8  hours  per  day,  220  days  per  yecur  in  school.  (A 
Nation  At  Risk,  page  21) 

^  That,  out  of  30  hours  of  student  attendance  in  school  each  week,  the 
average  school  provides  22  hours  of  academic  instruction,  and  some 
schools  provide  only  17  hours.     (Risk,  page  22) 


INPUTS 
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®  That,  because  cf  differences  among  teachers  in  their  ability  to 
manage  classroom  time,  scrae  students  may  receive  only  one-iifth  the 
instruction  in  readme  ccrrprehension  that  is  provided  to  other 
students.     (Risk^  page  22) 

°  That,  in  most  schools,  students  are  not  taught  how  to  manage  their 
time,  through  planned  and  systematic  ixistruction  in  study  skills • 
(Risk,  page  22) 

**  And  that  students  in  the  U.S,  are  asked  to  spend  too  little  time  on 
homework,  and  the  time  they  spend  on  it  has  declined,     (Risk,  page  19) 

What  the  Commission  could  not  report > . . 

• . , concerning  the  volume  of  time  allocated  to  schooling: 

*  How  much  states  and  l^cal  school  districts  vary  in  the  length  of  the 
school  day  or  school  ^^ediTi    for  example,  how  many  districts  provide 
five,  six,  or  seven  hours  of  attendance  per  day,  or  what  proportion  of 
districts  offer  more  or  fewer  than  180  days  of  instruction  per  year? 

^  Whether  the  length  oC  the  typical  school  day  or  school  year  has  been 
increasing  or  decreasing  over  time  in  this  country.  ( 

•  •  .concerning  the  use  of  time  by  teachers  and  students: 

^  Whether  (and  how  much)  schools  around  the  country,  at  both  the 
elementary  and  secondary  levels,  vary  in  the  proportion  of  allocated 
time  that  they  actually  schedule  for  academic  instruction. 

^  How  U.S.  schools  compare  with  schools  in  other  countries  in  the 
proportion  of  allocated  time  that  they  schedule  for  academic 
instruction. 

^  How  U.S.  teachers  compare  with  teachers  in  other  countries  in  their 
ability  to  manage  classroom  time. 

^  Whether  teachers  have  become  more  or  less  proficient  over  the  years 
in  their  ability  to  engage  students  in  academic  learning. 

^  Whether  students  in  other  countries  are  taught  work  habits  and  study 
skills  better  thcui  students  are  taught  these  skills  in  tliis  country. 

^  How  much  variation  exists  in  the  teaching  of  study  skills  among 
schools  in  this  country,  cmd  whether  the  variation  is  systematically 
related  to  characteristics  of  the  schools.     (Do  certain  types  of 
schools  provide  this  kind  of  instruction?)  , 

^  And,  how  U.S.  students  compare  with  students  in  other  countries  in 
how  much  homework  they  are  required  to  do. 
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2.  Content — the  courses  taken  by  students /  or  the  subject  matter 

presented  to  students ^  and  the  substance  learned  in  these  courses. 

What  the  Commission  reported  concerning  content: 

^  That  high  school  students  have  migrated  to  the  general  track  from 
vocational  and  college-prep  programs,  resulting  in  a  lack  of  focus  in 
their  curricula.     (Risk,  page  18) 

That  few  high  school  students  were  taking  courses  in  such  subjects 
as  advanced  math,  foreign  languages,  or  geography,  even  though  these 
courses  have  been  offered  to  them,  generally.*     (Risk,  page  18) 

^  And  that  too  many  of  the  credits  being  earned  by  high  school 
students  have  been  in  courses  in  health  and  physical  education, 
out-of-school  work  experience,  remediation,  and  courses  aimed  at 
personal  service  or  development,  such  as  training  for  adulthood  and 
marriage.*     (Risk,  page  18-19) 

(The  Commission  addressed  the  courses  taken  by  high  school  students 
under  two  areas — under  "Content,"  concerning  the  nature  of  the 
coursework  students  cake  or  do  not  take,  and  under  "Stcuidards  and 
Expec  cations , "  reflecting  the  rigor  of  the  programs  of  coursework  we 
expect  of  students.     Indicators  of  the  nature  of  the  coursework  taken 
by,  or  presented  to,  students  are  discussed  here.) 

What  the  Commission  could  not  report  concerning  content; 

®  The  nature  of  the  cotirses  taken  by  students  in  high  school.* 

^  The  content  of  the  courses  taken:    for  example,  what  students 
study  in  "General  Science"  or  "World  History"  in  high  school,  or  in 
English  in  the  fifth  grade. 

®  Whether  the  set  of  courses  typically  tedcen  by  students  in  high 
school  has  changed  over  time,  beyond  shifts  among  tracks  or  programs. 

^  How  the  substance  of  the  courses  offered  to,  and  taken  by,  students 
in  high  school,  or  the  substance  of  sv±>ject  matter  taught  in 
elementaury  school,  has  changed  over  time. 

®  Whether  the  courses  taken  by  students  in  high  school  in  this  country 
differ  from  the  courses  taken  by  high  school  students  in  other 
countries. 

^  Whether,  and  how,  the  substance  of  the  courses  typically  offered  and 
taken  by  students  in  high  school,  or  the  substance  of  the  sxibject 
matter  taught  in  elementary  school,  differs  among  industrialized 
countries • 


*The  Commission  was  able  to  report  on  students'  course- taking  patterns 
only  because  it  requested  and  supported  a  one-time  survey  of  the 
transcripts  of  high  school  graduates.    The  information  was  not  then 
readily  available  among  data-reporting  activities,  and  still  is  not. 
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®  How  the  content  of  courses  taken  by  students  in  high  school,  or  of 
subject  matter  taught  in  elementary  school,  corresponds  to  what  the 
public  and  its  educational  leaders  feel  the  schools  should  teach/ 

°  Whether  the  material  in  widely-used  textbooks  is  up  to  date. 


3.  Standards  and  Expectations — The  requirements  and  values 
communicated  to  students  at  points  in  their  school  careers. 

What  the  Commission  reported  concerning  standards  and  expectations; 

*  That/  during  a  period  of  time  when  the  amount  of  homework  assigned 
to  students  was  declining,  grades  rose  and  achievement  fell,  (Risk, 
pages  19-20) 

^  That  students  in  other  countries  were  required  to  take  three  times 
as  many  advauiced  mathematics  and  science  courses  as  students  in  the 
U.S.     (Risk,  page. 20) 

^  That  states  recjulred  too  few  courses  in  the  academic  basics  of 
mathematics,  science  and  computer  technology,  social  studies,  English, 
and  foreign  l^anguages.     (Risk,  page  20) 

^  That  statewide  testing  programs  aimed  almost  universally  for 
"minimal**  competencies,  minimums  which  had  become  the  *'maximum*' 
expectations  that  were  communicated  to  students.     (Risk,  page  20) 

^  That  many  public  colleges  have  changed  their  admission  policies  to 
accept  any  high  school  graduate  in  their  state,  serving  notice  that 
the  nature  of  a  student's  coursework  or  his  or  her  grade  point  average 
in  high  school  make  no  difference  in  determining  whether  he  or  she 
attends  college.     (The  Commission  noted  that  a  trend  in  this  direction 
also  had  taken  place  among  more  selective  colleges  and  universities «) 
(Risk,  pages  20-21) 

^  And  that  the  textbooks  and  other  instructional  materials  used  in 
school  demand  too  little  of  students,  having  been  written  down  to 
lower  reading  levels,  showing  less  and  less  of  the  influence  of 
experienced  teachers  and  scholars,  and  presenting  students  with 
academic  material  that  would  not  be  likely  to  challenge  many  of  them. 
(Risk,  page  21) 

What  the  Co^jnission  could  not  report  concerning  standjtrds  and 
expectations : 

*  Whether  the  courses  required  by  states  for  graduation  from  nigh 
school  have  changed  over  time#  and,  if  so,  how. 

^  Whether  local  course  reG[uirements  for  high  school  students  differ 
from  state  requirements,  and,  if  so,  what  they  are  and  how  they 
differ. 


*  Whether  local  requirements  are  changing  over  time,  and,  if  so,  how. 


°  The  rigor  of  the  school  work  that  is  actually  required  of  students 
through  assignments,  homework,  and  course  tests  and  quizzes,  beyond 
the  inferences  that  can  be  made  from  textbooks  and  achievement  tests. 


f 


^  Whether  and  how  the  academic  demands  of  school  work  have  chanu^d 
over  time,  and  how  the  work  done  by  students  in  thxs  country  compares 
with  the  work  required  of  students  in  other  countries. 

^  Whether,  in  general,  the  content  of  textbooks  has  become  less 
demanding,  academically,  over  time,  or  whether  the  books  have  just 
become  easier  to  read. 

^  Whether  state  and  local  testing  programs  are  becoming  more  or  less 
demanding,  over  time. 

^  What  standards  or  expectations  grades  or  teacher  testing  in  subject 
matter  communicate  to  students,  and  how  these  teacher  stemdards  or 
expectations  compare  with  local  or  state  achievemeni:  testing  and 
minimal  competency  testing. 

^  How  the  standards  represented  by  grades  and  teacher  testing  in  this 
country  con^are  to  grading  and  subject  matter  testing  of  teachers  in 
other  countries. 

^  Whether  grading  has  become  "inflated"  over  time — that  is,  whether 
teachers  are  giving  higher  grades  for  coD^)arable  work,  coo^ared  with 
greuies  given  in  the  past. 

^  Whether  there  has  been  a  trend  up  or  down  over  time  in  the  use  of 
tests  or  other  standards  to  determine  if  a  student  is  promoted  from 
grade  to  grade  or  level  to  level  in  school. 

^  Whether  the  school  systems  of  other  countries  use  tests  cind  other 
yardsticks  more  than  we  do  to  determine  progress  through  the  school 
system. 

*  Whether  parents  expect  more  or  less  from  their  children  in  school 
now  than  they  used  to  expect  and  communicate. 


4.  Teaching — the  quality  of  teaching  as  a  practice  and  as  a 
profession. 

What  the  Commission  reported  concerning  the  quality  of  teaching. .. 
. . .as  a  practice: 

^  That  the  aptitude  test  scores  of  students  going  into  teaching  are 
too  low.     (Risk,  page  22} 

^  That  too  little  of  the  teacher  preparation  program,  especially  for 
the  preparation  of  elementary  school  teachers,  consists  of  courses  in 
educational  methods,  and  too  little  in  the  subjects  to  be  taught. 
(Risk,  page  22) 
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as  a  profession; 


®  That  teachers  are  paid  too  little  and  have  too  little  responsibility 
for  important  professional  decisions,  such  as  the  selection  of  the 
textbooks  they  use,     (Risk,  pages  22-23) 

°  That  there  are  critical  shortages  of  teachers  in  certairj  siibjects 
(mathematics,  science,  and  foreign  languages)  and  specialties 
(education  of  the  gifted  and  talented,  of  language  minority  students, 
and  of  the  disadvantaged) •     (Risk,  page  23) 

°  And  that  shortages  of  teachers  in  mathematics,  science,* and  English 
are  resulting  in  a  large  proportion  of  new  teachers  hired  to  teach  in 
these  areas  who  cuce  not  trained  or  certified  to  teach  the  subjects. 
(Risk,  page  23) 

What  the  Commission  could  not  report  concerning  the  quality  of 
teaching. • • 

. . . as  a  practice ; 

The  capability  of  our  teachers,  directly  measured,  in  the 
professional  practice  of  planning  eind  conducting  lessons. 

°  The  pedagogical  skill,  generally,  of  our  teachers,  compared  with  the 
teachers  of  the  past,  or  with  the  classroom  skill  of  teachers  in  other 
coiin  tries  • 


^  The  quality  of  teachers'  knowledge  of  the  subject  matter  they  teach, 
measured  against  notions  of  what  they  should  know,  compeured  with 
teachers  in  the  past,  or  compared  with  teachers  in  other  countries. 

The  ability  of  our  teachers  to  teach  academic  subjects  to  students 
who  vary  in  background,  capability,  and  interest  or  motivation; 
Aether  our  teachers  are  improving  in  this  ability  over  time;  and  how 
our  teachers  compeure  in  this  regard  with  teachers  trained  in  other 
countries . 

^  The  relationship  between  alternative  approaches  to  teacher 
preparation  ud  the  relative  proficiency  of  teachers  in  the  classroom. 

^  The  prevalence  or  status  of  different  approaches  to  teacher 
preparation  that  seem  to  be  either  successful  or  unsuccessful. 

The  ability  of  teachers  to  handle  classroom  discipline  problems;  how 
this  ability  has  been  changing  over  time;  euid  how  our  teachers  compare 
in  this  regard  with  teachers  in  other  countries. 

^  The  nature  and  success  of  efforts  by  school  systems  and  states  to 
improve  the  proficiency  of  teachers  through  staff  development  or 
inservice  training. 

What  the  Commission  could  not  report  concerning  the  quality  of 
teaching. . . 
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^  The  range  in  average  teacher  salaries  among  states ^  school 
districts f  and  professional  specializations. 

How  the  salaries  of  U.S.  teachers  compare  with  those  of  teachers  in 
other  countries f  in  terms  of  relative  buying  power,  and  whether  the 
buying  power  of  teachers  is  going  up  or  down  in  different  countries. 

®  Early  indicators  of  the  long-range  supply  of  teachers ,  such  as  the 
career  intentions  of  students  graduating  from  high  school. 

®  Reasons  cited  by  high  school  seniors  or  college  students  for  not 
going  into  teaching  (ie,  low  salaries ^  the  poor  prestige  of  the 
profession,  perceptions  of  teachers  having  little  professional 
autonomy,  poor  working  conditions,  etc.). 

®  The  relative  importance  of  various  incentives  in  making  teaching 
more  attractive  to  those  in  the  profession,  such  as  higher  salaries  f 
greater  possibility  for  career  growth,  more  professional  autonomy, 
better  working  conditions  and  support. 

The  status  of  various  professional  incentives  for  teachers,  both  in 
this  country  over  time  and  in  other  countries. 

Systematic  tracking  of  the  demand  for,  and  supply  of,  teachers 
broken  down  into  various  professional  specialties,  and  reported  for 
states  or  regions  of  the  country. 

Trends  over  time  in  the  standards  applied  by  states  to  certify  new 
teachers  and  to  maintain  the  certificates  of  veteran  teachers. 

The  nature  of  the  standards  applied  by  local  school  districts  in 
recruiting  and  retaining  teachers #  including  the  use  of  different 
approaches  for  evaluating  teacher  performance. 

How  the  public  perceives  the  status  of  teaching  as  a  profession,  and 
how  this  has  chamged  over  time. 

^  Perceptions  of  the  status  of  teaching  as  a  profession  in  this 
country,  compared  to  its  prestige  in  countries  with  different 
histories,  cultural  vctlues,  and  organizational  structures  for 
education. 


5.  Leadership  and  Support — Efforts  by  the  public,  policy-makers,  and 
parents  to  support  and  provide  direction  to  the  schools. 

(The  Commission  on  Ex  3llence  did  not  report  findings  having  to  do 
with  the  support  and  leadership  provided  to  the  schools,  but  the 
Commission  did  make  recommendations  in  this  area^  implying  the  need 
for  the  following  indicators,  which  do  not  seem  to  be  available,  now:} 

Regular  reports  of  the  fiscal  effort  put  forth  by  different 
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countries  to  support  their  schools,  in  terms  of  school  expenditures  as 
a  proportion  ot  GKP, 

*  Evidence  of  the  range  and  level  of  specific  efforts  to  support 
schools  at  the  state  and  local  levels,  such  as  levels  of  expenditure, 
number  or  propurrion  of  bond  issues  passed,  or  changes  in  state 
appropriations  for  education* 

®  The  range  in  tax  burden  for  education  among  states  and  local  school 
districts. 

The  relative  cost  of  meeting  different  educational  demands,  such  as 
education  of  disadvantaged,  handicapped,  or  gifted  and  talented 
students. 

*  Geographical  differences  in  the  costs  of  education,  such  as  the 
costs  among  regions  of  the  country  or  different  costs  for  schooling  in 
sparsely-populated  areas,  cities,  and  other  types  of  community. 

The  relationships  between  cost  factors  and  educational  outputs. 

The  involvement  of  parents  and  the  local  community  in  making 
decisions  about  school  programs,  or  in  contributing  to  these  programs. 

*  The  nature  and  level  of  efforts  by  parents  to  monitor  and  encourage 
the  progress  of  their  children  in  school. 

^  The  nature  and  number  of  cooperative  programs  beween  business  and 
the  schools. 

*  The  perceptions  of  policymakers  and  leaders  at  the  national,  state, 
and  local  levels  about  the  quality  of  the  schools  and  what  the 
strengths  and  weaknesses  of  the  schools  may  be. 

^  The  nature  of  school  improvement  efforts  being  launched  at  the 
national,  state,  and  local  levels,  and  trends  in  these  efforts  over 
time. 


OUTPUTS 

What  the  Commission  reported  concerning  student  achievement  (Risk, 
pages  8-9) : 

^  That  there  had  been  general  patterns  of  decline  in  scores  on 
standardized  achievement  tests  administered  nationwide. 

*  That  scores  had  declined  in  general  on  the  Scholastic  Aptitude 
Tests. 

That  scores  had  declined  on  the  College  Board  achievement  tests  in 
subjects  such  as  physics  and  English. 

^  That  achievement  in  science  had  declined  steadily  on  the  National 
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Assessment  of  Educational  Progress  from  1969  to  1977.  ^  ^ 

*  That  there  were  specific  problems  of  poor  (and  declining) 
performance  in  the  "higher  order"  a&pecrs  of  reading,  writing,  and 
mathematics  on  the  National  Assessment* 

•  That  U.S.  students  fared  poorly  in  international  comparisor  of 
achievexoent . 

•  That  the  number  and  proportion  of  students  scoring  650  or  higher  on 
the  SAT's  had  dropped, 

*  That  most  gifted  students  appear  to  be  achieving  at  a  level  below 
their  tested  aptitude. 

That  scores  on  the  Graduate  Record  Examination  had  declined. 

Results  of  one-time  svirveys  of  functional  illiteracy  which  indicated 
that  about  23  million  adults  were  functionally  illiterate,  that  about 
13%  of  school-aged  youth  were  functionally  illiterate,  and  that  over 
40%  of  minority  youth  were  functionally  illiterate. 

The  Commission  also  recognized  (Risk,  page  11}  that  the  average  person 

in  the  U.S.  today  is  provided  more  schooling  (if  not  better  schooling) 

than  the  average  person  received  a  generation  ago.    This  point  is 

based  on  steady  Increases  in  the  proportions  of  people  completing  high 

school,  attending  college,  or  con^leting  college  over  the  past  80-100  ^ 

years. 

What  the  Commission  could  not  report  concerning  student  achievement: 

The  niimber  or  proportion  of  students  nationwide  who  seem  to  know 
concepts  and  principles  that  would  be  recognized  as  basic  to  the 
academic  subjects  taught  at  different  levels  in  school.    For  example, 
how  many  students  understand  and  can  apply  the  e^erimental  method  in 
science,  know  the  central  theme  of  Moby  Dick,  or  can  apply  tenets  of 
the  Bill  of  Rights  to  conten4)orary  situations? 

The  achievement  of  today's  students  In  the  U.S.  compared  with 
contemporary  students  in  other  countxles,  as  opposed  to  comparisons 
made  10-15  years  ago. 

The  ability  of  students  in  the  U.S.  to  solve  co&plex  problems  in  the 
different  academic  subjects  by  finding  and  Interpreting  the 
appropriate  Information,  reasoning  analytically,  and  expressing  their 
conclusions  effectively. 

Trends  over  time  on  a  conprehensive  index  of  our  educational 
productivity  that  would  be  more  meaningful  than  SAT  scores;  for 
example,  Kurtz  and  I  (Wurtz  £uid  Selden,  1985)  have  suggested  an  annual 
"national  educational  index"  based  on  the  product  of  two  nun:bers:  the 
proportion  of  a  common  core  of  academic  content  objectives  that 
students  seem  to  have  learned  each  year,  and  the  percentage  of 
students  who  have  complete  certain  levels  of  schooling,  such  as  high 
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school,  that  year,     (Such  an  index  cou  .  should,  also  be  adjusted 

for  costs  and  educatir^al  effort  facto  time  and  among 

school  systems.) 

^  Trends  over  time  in  basic  measures  of  educational  dchievement,  such 
as  functional  illiteracy. 

®  The  range  in  average  student  achievement  among  significant  political 
units #  such  as  states  or  a  sample  of  local  school  districts. 

^  Trends  in  achievement  over  time  in  states  or  in  local  school 
districts  facing  different  challenges  and  situations. 

(Since  the  Commission  did  not  consider  many  individual  indicators  of 
student  participation  and  retention  in  school i  and  since  these  are 
areas  where  existing  data  are  relatively  extensive  and  useful,  I  will 
not  devote  space  to  consider  what  indicators  of  petrticipation  may  not 
be  available.) 


Why  We  Do  not  Know  Some  of  the  Things  We  Need  to  Know  About  Our 
Schools  . 

Given  this  preliminary,  crudely-organized  list  of  some  of  the 
indicators  I  believe  the  Commission  could  have  used,  but  that  I  do  not 
believe  were  available  to  it/  let  me  conclude  by  considering  why  these 
indicators  may  not  be  available,  so  we  can  at  lea*-     x^int  toward 
developing  them  in  the  future.  - 

First,  let  me  explain  the  tests  that  I  did  and  did  not  apply  to 
this  list.    ^  have  tried  to  list  only  indicators  that  are  relatively 
significant,  that  is,  they  involve  variables  and  analyses  that  would 
be  particularly  useful  to  educational  decision-makers  and 
policy-makers.    Second,  I  have  relied  on  my  knowledge  of  the  data  on 
the  educational  system  that  are  and  are  not  available  on  a  regular 
basis.    I  have  not  been  able  to  conduct  exhaustive  searches  to  verify 
my  understanding  in  every  case.    In  some  cases  (not  many,  I  hope)  i  I 
may  not  be  informed  well  enough;  in  other  cases  we  may  agree  that 
related  data  are  available,  but  I  will  believe  that  they  are  not 
fine*grained  enough,  or  regular,  enough  to  be  useful. 

INPUTS 

Time.    The  status  of  indicators  concerning  the  amount  of  time 
scheduled  and  allocatad  to  schooling  reveal  a  problem  that  will  recur 
frequently  in  this  discussion.    The  length  of  the  school  year,  the 
length  of  the  school  day,  and  the  structure  of  the  school  day  are  set 
by  states  I  more  or  loss  officially  depending  on  the  atate.  Local 
school  districts  and  individual  schools i  public  and  private,  may  meet, 
fail  to  meet,  or  exceed  these  standards,  so  that  local  practice  may 
vcury  substantially.    Only  a  census  of  the  states  and  a  reg^ilar  survey 
of  local  districts  would  reveal  norms  and  the  degree  of  variability 
around  the  norm  for  these  dimensions,  and  each  brings  with  it  effort 
in  terms  of  data  collection  and  reporting. 

Indicators  involving  how  time  is  used  in  school  introduce  the 
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second  problem  endemic  to  indicators.    Even  though  we  know  that  hpw 
teachers  use  scheduled  time  is  important,  measuring  this  variable 
validly  and  monitoring  it  over  time  or  among  school  systems  present 
serious  technical  challenges,  and  would  probably  be  costly. 
Similarly,  measuring  and  tracking  how  well  students  are  taught  to  use 
their  own. time  to  enhance  learning  would  be  difficult  and  costly. 

Content.    The  problem  her^  seems  to  be  the  level  of  detail  of  the 
information  ve  collect.    We  are  just  beginning  to  monitor  the  courses 
thLt  are  required  by  states  and  local  school  districts  for  graduation 
from  high  school.    While  these  efforts  have  been  one-shot  projects 
conducted  to  monitor  recent  reform  initiatives,  they  could  be  made 
regular  quite  easily.    The  bigger  challenge  is  collecting  information 
on  what  students  study  below  the  level  of  the  course:    what  is 
typically  presented  to  students  in  each  subject  at  each  level  of 
school,  and  how  much  does  this  content  vary  among  schools  around  the 
country?    This  would  require  surveys  of  state  and  local  curriculum 
objectives,  content  analyses  of  widely-used  textbooks,  and  surveys  of 
teacher:?  to  describe  what  other  content  and  activities  they  present  to 
their  students • 

Steaidards  enxd  Expectations,    Needed  here  are  surveys  of  state, 
local,  and  classroom  practices  in  setting,  communicating,  and 
enforcing  academic  standards  for  students.    We  know  how  many  states 
have  minimal  competency  testing  programs,  and  we  recently  learned  what 
subjects  they  cover,  at  what  levels  they  are  administered,  and  how 
they  are  used,  in  most  states.    We  also  know,  from  occasional  surveys, 
how  much  homework  students  are  assigned.    We  do  not  know  what 
standards  states  and  local  school  districts  apply  to  promote  students 
from  level  to  level.    We  do  not  know  what  criteria  teachers  apply  in 
assigning  grades  and  how  they  might  be  changing  over  time.    We  do  not 
know  how  teachers  use  classroom  tests  of  subject  matter.    We  do  not 
know  enough  about  what  parents  expect  of  their  children  in  school,  or 
how  well  the2;e  expectations  are  communicated  to  students*    In  order  to 
obtain  this  information,  we  would  need  new  or  expanded  surveys  of 
accreditation  bodies,  local  school  administrators,  teachers,  parents, 
and  students* 

Teaching.    Indicators  of  the  quality  of  teaching  as  a  practice 
suffer  one,  central  shortcoming:    they  are  all  indirect.    We  infer  the 
conpetence  or  profecsional  skill  of  teachers  from  aptitude  test 
scores,  college  grades,  courses  studied,  paper-and«pencil  qualifying 
examinations,  and  compliance  with  certification  standards #  but  not 
from  direct  measures  of  the  ability  of  teachers  to  teach  students.  To 
measure  teaching  skill  directly,  we  would  need  an  informed  definition 
of  the  qualities  and  behaviors  that  go  into  good  teaching,  and  then  we 
would  need  to  operatic nalize  this  definition  (or  multiple  definitions) 
with  procedures  for  observing  teachers.    With  definitions  and 
operating  procedures  (which  some  states  wd  many  local  school 
districts  are  developing  in  order  to  evaluate  teachers)  a  national,  or 
internaticn.\l,  sample  of  teachers  could  be  observed  periodically  to 
provide  Icnc/ltudinal  and  comparative  data  on  the  overall  pedagogical 
ability  of  teachers.    With  these  techniques,  we  could  also  refine  the 
observational  methods  to  measure  special  abilities  of  ^eachers — the 
ability  to  teach  students  with  particular  characteristics  with  which 
we  are  concerned,  or  to  do  other,  specific  aspects  of  the  job  of 
teachi.ng. 


510 


Indicators  on  teaching  as  a  profession  will  probably  fill  in 
quickly •    There  is  a  great  demand  for  information  on  what  state  and 
local  school  systems  are  doing  to  enhance  incentives  and  working 
conditions  for  teachers r  covering  salaries r  pay-for-perfornance 
provisions,  career  ladders,  professional  evaluation  systems,  and  steps 
to  reduce  non-professional  duties  and  stress.    The  challenges  for 
indicators  in  this  area  seem  to  be  arriving  at  standard  definitions  of 
concepts  such  as  salaries,  benefits,  and  prof essioi.al  incentives,  and 
then  setting  up  routine  programs  and  procedures  for  collecting  and 
reporting  this  information  on  states  and  local  school  districts. 

Leadership  and  Support.    The  Commission's  analysis,  and  the 
school  improvement  efforts  thar  came  with  the  reform  movement  of  which 
the  Commission  was  a  part,  included  many  recommendations  for  local 
school  leaders  and  administrators  to  enhcuice  the  involvement  and 
support  of  parents,  citizens,  businesses  cind  others  in  the  schools. 
To  track  these  efforts  and  at  least  their  perceived  effectiveness, 
surveys  would  be  needed  of  school  administrators,  school  bocird 
members,  business  leaders,  cuid  others  to  determine  the  extent  and 
nature  of  efforts  they  have  made  to  develop  community  support  and  to 
exercise  new  levels  of  leadership  for  the  schools. 


OUTPUTS  ( Ach  ievement ) 

Currently-avail£Lble  achievement  indicators  are  lacking  in  their 
level  of  detail.    The  National  Assessment  of  Educational  Progress  h&s 
made  a  major  contribution  in  providing  us  with  periodic,  national  data 
at  three  age  levels  on  student  achievement  in  each  of  the  basic 
academic  subjects.    What  we  need  beyond  this  is  to  break  down 
achievement  data  into  greater  detail.    We  need  to  monitor  the  specific 
portions  of  the  core,  acadesiic  subject  matter  we  eire  concerned  with  in 
the  schools  that  students  know  and  do  not  know.  ^  NAEP  is  being 
augmented  to  assess  the  status  of  this  kind  of  specific, 
subject-matter  knowledge  in  the  «u:eas  of  literature  and  American 
history.    Collecting  this  level  of  information  across  subjects  on  a 
regul2u:  basis  would  permit  more  effective  fine-tuning  of  educational 
programs  at  the  state,  local,  and  classroom  levels,  allowing  us  to 
attend  to  those  parts  of  the  academic  program  that  students  do  not 
seem  to  be  learning.    We  cannot  do  this  with  the  level  of  detail 
offered  by  NAEP's  current  design.    We  also  need  more  detailed  san^ling 
and  reporting,  so  that  outcomes  on  the  Assessment  can  be  reported  by 
state  and  by  meaningful  types  of  local  school  district.    Finally,  we 
need  to  collect  information  on  educational  programs  or  efforts  that 
are  associated  with  student  achievement,  in  order  to  begin  to 
understemd  what  educational  efforts  or  approaches  seem  to  provide  the 
best  results;  NAEP  has  begun  to  collect  this  kind  of  information  on 
the  schools  it  samples,  and  this  effort  should  be  refined  and 
developed. 

International  indicators  of  achievement  suffer  mainly  from 
infrequency.    The  lEA  studies  are  on  a  10-  to  15-year  cycle,  meeuilng 
that  sometimes  the  most  recent  availcible  comparative  data  axe  very 
old.    Five  years  would  seem  to  be  a  reasonable  time  period  for  this 
cycle,  to  ensure  that  comparslons  are  not  erroneously  extrapolated 
from  situations  that  no  longer  exist.    Alor.g  with  a  shorter  cycle. 
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lEA-type  studies  should  be  made  more  routine.    Under  the  present 
arrangements  for  conaucting  the  lEA,  we  cannot  count  on  the  studied 
heme,  repeated  in  the  future;  each  cycle  is  conducted  through  private 
organizations  in  an  ad  hoc  way.    The  program  should  be 
institutionalized  so  that  participation  in  the  studies  and  support  for 
them  can  be  relied-upon. 


Summary 

I  have  attempted  to  do  three  things  in  this  paper.    The  first  was 
to  establish  a  structure  by  which  one  could  talk  about  educational 
indicators — both  those  that  we  already  know  about  and  those  that  we 
may  need,  but  do  not  have  available  to  us,  now.    The  second  was  to 
describe  some  of  the  indicators  that  at  least  one  group,  the  National 
Commission  on  Excelle'^  e  in  Education,  was  unable  to  analyze  because 
they  did  not,  and  stil    do  not,  seem  to  be  available.    The  third  was 
to  speculate  briefly  on  what  would  be  involved  in  developing  at  least 
some  of  the  important  indicators  that  we  are  missing. 

This  paper  should  really  be  used  a  pilot-test  for  a  process  that 
should  be  done  more  thoroughly  and  systematically,  but  it  does  reveal 
both  that  there  are  important  kinds  of  information  about  education 
that  we  lack,  and  that  we  can  identify  and  address  these  gaps. 
Venturing  forward  into  these  undeveloped  areas  will  take  time,  effort, 
and  money,  but  few  tasks  offer  as  great  a  potential  to  give  us  useful 
tools  for  ijnproving  education.    Information  is  power,  and  better 
information  about  education  would  give  us  tremendous  leverage  in 
managing  and  improving  it. 
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Improving  the  Quality  and  Usefullness  of  NCES  data 

( 

Marshall  Smith 
University  of  Wisconsin,  Madison 

This  paper  sketches  seven  activities  that  NCES  should  pay 
attention  to  over  the  next  few  years  as  it  attempts  to  provide 
accurate. and  complete  data  on  the  elementary  and  secondary 
education  system  of  the  United  States •    No  attempt  is  made  in 
this  discussion  to  be  comprehensive  and  no  logical  or 
programmatic  priority  should  be  inferred  from  the  order  of  items 
on  the  list. 


1)  .    Act  aggressively  to  meet  the  major  problems  of  data 
collection  and  establish  a  system  to  monitor  the  aualitv  of  NCES 
data.    Over  the  past  year  there  have  been  a  niimber  of  internal 
(Dept.  of  Education)  and  external  (GAO,  "The  Sorry  State...") 
critiques  of  various  aspects  of  data  gathered  and  reported  by 
NCES.    The  time  is  right  to  dedicate  resources  to  meet  these 
problems.    One  approach  is  to  deliberately  review  the  critics' 
points  and  make  adjustments  to  meet  each  of  the  specific 
criticisms.    Another  approach  is  to  work  with  the  NAS  committee 
reviewing  NCES  to  examine  areas  that  need  improvement  and  to 
suggest  ways  of  implementing  corrective  action.    Both  approaches 
and  others  should  be  used  and  a  clear  document  spelling  out  what 
NCES  intends  to  do  and  is  doing  about  the  quality  of  their  data 
should  be  developed  and  released  to  the  field  for  comment.  Where 
resources  are  not  available  or  where  policy  (legislative  or 
administrative)  gets  in  the  way  of  improving  the  data  collection 
this  should  be  pointed  out  in  the  document  and  a  strategy 
indicated  for  meeting  the  problems. 

Beyond  correcting  the  immediate  problems  three  other  steps 
should  be  taxen.    First,  I  have  a  hunch  that  there  is  a  great 
deal  Cj:  unnecessary  and  useless  data  collected  because  of 
legislative  or  administrative  mandate  or  because  it  has  been 
collected  in  the  past  and  no-one  has  gotten  around  to  examining 
its  continued  utility.    It  would  be  useful  to  ask  the  Academy  and 
internal  NCES  staff  to  suggest  candidates  for  reduction  in  data 
collection.    Second,  you  should  establish  a  system  of  yearly 
review.     I  don't  have  in  mind  anything  fancy.  One  approach  would 
combine  internal  and  external  review.    For  example,  internally  to 
NCES,  on  a  rotating  basis  each  year  a  Director  of  one  of  the  NCES 
programs  could  have  an  assignment  of  producing  a  planning 
document  about  ways  of  improving  data  collection  and  data  use  in 
the  agency.    Or,  internally  to  the  department,  each  year  the 
planning  office  might  be  requested  to  review  a  different  aspect 
of  the  data  collection  program  and  use  of  the  data  in  the 
Department.    On  the  outside  you  might  contract  with  a  single 
particularily  knowledgeable  person  each  year  to  produce  a  short 
(25  page)  provocative  paper  on  one  or  another  aspect  of  the  data 
collection  and  analysis  activities  of  the  <igency.    These  papers 
might  look  both  at  present  problems  and  future  opportunities. 
The  effort  to  gain  outside  advice  (beyond  the  Advisory  Committee) 
should  not  end  with  the  effort  of  which  this  paper  is  a  part. 
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Third,   it  should  be  possible  to  establish  an  ongoing  system  ( 
for  partial  verification  of  NCES  data.     One  approach  would  be  to 
use  the  Quick  Response  survey  to  cross-validate  certain 
statistics  each  year.    Another  strategy  would  be  to  work  with 
certain  key  states  each  year  to  develop  cross-validating  systems 
of  data  collection.     I  do  not  t>^ink  that  you  should  engage  in 
massive  cross-validation.     The  effort  should  be  limited  and 
selective.    Major  problems  signalled  by  discrepancies  which 
occurred  in  the  cross-validation  would  require  larger  efforts  to 
correct  but  the  frequency  of  major  problems  should  be 
substantially  reduced  by  such  an  on-going  attempt  to  insure 
accuracy. 

2) .  Improve  and  coordinate  the  tests  of  academic  achievement  used 
in  major  surveys.  One  of  the  major  problems  with  the  HSB  survey 
is  the  quality  of  the  student  outcome  measures^  particularily  the 
student  academic  achievement  tests.    I  am  mindful  of  the  robust 
psychometric  properties  of  many  of  the  tests  —  as  ETS  has  shown 
in  their  recent  report.     I  also  understand  the  constraints 
imposed  by  attempting  to  have  direct  comparablity  among  different 
surveys  (eg.  che  NLS  and  the  HSB  and  presumably  the  NLS^  HSB  and 
HSB2)  and  by  the  need  to  minimize  the  time  spent  by, the  students 
taking  the  tests.    One  component  of  the  problem  rests  with  the 
lack  of  relationship  between  the  content  of  the  tests  and  the 
curriculum  of  schools.     One  version  of  this  cri'jicism  comes  from 
content  specialists  eyeballing  the  tests  and  claiming  that  there 
is  little  relationship  between  the  tests  and  the  curriculum.    For  / 
example^  there  is  little  attention  paid  to  the  content  of  English 
and  History — the  subjects  in  high  school  in  which  students  spend 
a  large  percentage  of  their  time.    And  the  tests  assess  only  a 
limited  conception  of  math  and  science.    Another  related  version 
of  the  criticism  comes  from  the  observation  that  while  the  tests 
measure  a  little  of  what  students  learn  in  academic  courses  they 
measure  nothing  at  all  of  what  they  learn  in  most  general  and  all 
vocational  courses.    By  their  design^  therefore,  they  are  missing 
much  of  what  high  schools  intend  to  teach.    The  general  problem 
of  the  lack  of  relationship  between  the  tests  and  the  curriculxam 
is  manifested  by  the  very  small  gains  between  10th  and  12th 
grades  represented  either  absolutely  (raw  score)  or  relatively 
(percent  of  standard  deviation  of  10th  grade  scores) . 

A  second  problem  has  to  do  with  the  nature  of  the  concepts 
assessed  by  the  HSB  tests.    The  multiple  choice  format,  the  short 
length  of  time  allocated  for  the  testing  and  the  survey  of 
knowledge  nature  of  the  tests  reduce  the  chances  for  the  measures 
to  assess  critical  thinking  or  higher  order  thinking  skills.  Work 
is  going  on  around  the  nation  in  the  area  of  assessing  higher 
order  skills.    Fredericksen' s  work  at  ETS,  the  ETS  GRE  Analytical 
Score  efforts,  and  Sternberg's  work  for  the  state  of  Connecticut 
are  three  examples.     In  addition  there  is  a  lot  of  exploration  of 
ways  of  using  the  computer  to  create  testing  environments  that 
assess  more  than  *"he  basic  skills. 

A  third  prob  .m  is  the  lack  of  correspondence  of  the  HSB 
tests  with  the  lEA,  the  National  Assessment  or  state  assessments. 
There  is,  at  best,  scattered  coordination  —  the  HSB  with  the 
NLS72,  the  National  Assessment  and  some  state  assessments  and,  I 
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gather  the  lEA  math,  are  examples.    Someone  should  systematically 
set  out  the  inter-relationships  among  the  existing  surveys  and 
examine  opportunities  in  the  future  so  that  maximum  coopdination 
(without  sacrificing  too  much  quality)  could  be  achieved, 

I  recognize  the  difficulty  in  solving  any  one  of  these  three 
problems  much  less  all  three.    For  one  thing,  NCES  does  not  have 
control  Over  either  the  NAEP^  or  the  lEA,    My  sense,  however,  is 
that  there  is  a  lot  going  on' in  the  field  of  testing  that  is 
important,  particularly  in  the  .theory  and  development  of  ways  to 
measure  complex  thinking  skills.      There  are  also  advances  in  the 
sampling  and  design  areas  (eg.  BIB  spiraling)  and  in  the  use  of 
computers  to  pose  complex  problems  and  to  tailor  tests.  Given 
this  ferment  it  would  be  well  worth  NCES's  time  to  get  some 
people  thinking  about  ways  of  ameliorating  the  three  problems 
indicated  above  as  well  as  other  test  related  issues.    A  few 
papers  and  a  couple  of  small  conferences  that  include  the  NAEP 
and  the  lEA  folks  and  a  number  of  the  leaders  of  state  assessment 
efforts  might  lead  to  some  suggestions  that  would  vastly  improve 
on  the  measures  that  are  currently  used. 

3)  .  Work  with  various  parties  to  build  an  indicator  system.  This 
issue  is  already  on  the  NCES  agenda.      I  want  to  reinforce  it. 
Over  the  next  few  years  NCES  should  take  the  lead  in  thinking 
about  and  implementing  new  and  better  ways  of  assessing  the 
health  of  the  nation^ s  educational  system.    Apart  from  it  being 
part  of  the  mandate  of  the  agency  the  time  is  ripe.  There  are  a 
number  of  key  roles  that  NCES  should  play.    NCES  should  be 
actively  coordinating  with  the  Chiefs,  the  National  Academy  of 
Sciences,  the  GAO,  the  NSF,  the  NIE  testing  and  state  and  local 
policy  centers  and  all  of  the  others  who  now  have  an  interest  in 
federal,  state  and  Ipcal  level  education  indicators.  Second, 
while  the  generic  concerns  of  NCES  are  allied  with  those  of  all 
of  the  other  actors  (high  quality  data,  minimize  burden  etc.) 
there  are  some  specific  federal  concerns  that  NCES  should  attend 
to    —  these  have  to  do  with  indicators  to  assess  the  equality  of 
the  nation's  educational  system  and  the  relationship  of  the 
system  to  the  nation's  productivity  and  to  the  nation's  defense. 
A  third  area  where  NCES  might  take  leadership  is  in  the 
development  of  new  strategies  for  developing  key  indicators  such 
as  ones  assessing  curriculum  or  teacher  quality. 

4)  .  Establish  an  international  program.      The  quality  of  data 
comparing  the  resources,  organization,  intentions  and  outcomes  of 
the  various  advanced  nations  of  the  world  is  very  poor.    The  lEA 
surveys,  which  tragically  are  state  of  the  art  in  this  area, 
suffer  from  lack  of  funding,  proper  coordination  internationally 
and,  in  the  US,  from  a  lack  of  connection  with  many  of  the 
established  ways  of  insuring  adequate  data  collection.  This 
combination  of  problems  has  led  to  erratic  schedules  for  data 
collection,  very  poor  response  rates  for  US  samples,  and  little 
use  of  the  lEA  data  by  the  US  policy  system.    One  way  of 
beginning  to  ameliorate  these  problems  would  be  to  have  NCES 
assume  responsiblity  for  coordinating  US  involvement  in  lEA 
activities. 

Other  than  the  lEA  there  are  only  scattered  sets  of 
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international  comparisons  /;hich  involve  the  US.     Some  are 
carefully  carried  out  though  they  have  only  limited 
generalizablity  because  of  sample  breadth  (for  example,  Harold 
Stevenson's  work)  —  others  suffer  from  major  problems   (the  Texas 
newspaper's  study).     I  don't  believe  that  NCES  should  have  much 
to  do  with  these  entrepreneurial  efforts  except  to  keep  track  of 
them . 

There  might  also  be  opportunities  for  cooperation  with  OECD 
or  with  other  nations,  singly  or  in  groups.    My  instinct  is  that 
there  ought  to  be  a  mechanism  within  NCES  to  seek  out  these 
chances  —  this  should  not  be  institutionalized  in  a  position, 
however.  The  Director  of  NIE  used  to  sit  on  the  CERI-OECD  board. 
This  might  be  an  avenue  for  coordination. 

5) .     Track  students  from  the  middle  school  vears  through  hioh 
school  and  beyond.    Analyses  of  data  from  HSB  have  demonstrated 
the  importance  of  tracking  students  while  they  are  in  high  school 
to  document  the  effects  of  schools  on  student  achievement  and 
attitudes.    Even  if  the  results  of  cross-sectional  analyses  on 
12th  grade  outcomes  are  corroborated  by  longitudinal  analyses  of 
10th  to  12th  grade  gains  the  added  confidence  in  the  results  that 
comes  though  the  longitudinal  addition  of  earlier  grade  test 
scores  and  attitudes  is  worth  the  investment.    And,  occasionally, 
it  tur^is  out  that  longitudinal  studies  provide  a  very  different 
set  of  findings  than  did  cross-sectional  data.  Beyond  that, 
longitudinal  data  collected  in  10th  through  12th  grade  in  HSB,  in 
contrast  to  the  data  collected  only  in  12th  grade  and  beyond  in 
the  NLS,  allowed  researchers  to  begin  to  examine  nationally  such 
issues  as  students'  reasons  for  dropping  out  and  the  short  and 
long  term  effects  of  dropping  out. 

Unfortunately,  10th  grade  is  not  early  enough  to  fully 
examine  the  effects  of  high  schools  on  student  achievement  and 
attitudes  or  the  reasons  of  students  for  and  consequences  of 
dropping  out,  among  other  issues.    By  10th  grade  many  students, 
particularily  poor  students  in  inner  cities,  have  already  either 
dropped  out  officially  or  stopped  attending  school.    According  to 
HSB  data,  for  example,  16%  of  the  nation's  students  drop  out 
before  graduation  from  high  school  —  most  other  national 
estimates  which  include  dropping  out  prior  to  10th  grade  place 
the  percentage  of  dropouts  as  25-28%.    The  exclusion  of  upwards 
of  40%  of  the  nation's  dropouts  from  the  HSB  analyseci  and,  in 
particular,  those  dropouts  who  left  school  prior  to  10th  grade, 
suggests  that  profiles,  analyses  and  policy  conclusions  developed 
from  the  existing  HSB  data  may  be  misleading  if  tney  are 
interpreted  as  representing  the  entire  population  of  dropouts. 

Our  ability  to  analyze  and  understand  other  high  school 
processes  is  also  limited  by  studies  which  gather  initial  data  on 
10th  graders.    The  phenonema  of  tracking  and  ability  grouping  is 
well  underway  prior  to  10th  grade  in  almost  all  high  schools — the 
determinants  of  these  assignment  practices  are  operating  by  7th 
and  8th  grade.    The  same  arguement  applies  to  the  comparison  of 
public  and  private  high  schools — most  of  the  selection  issues 
have  been  settled  long  ago  by  the  time  students  reach  the  10th 
grade.    Still  another  area  of  study  that  is  limited  by  studies 
which  begin  in  10th  grade  have  to  do  with  determinants  of 
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patterns  of  participation  in  extra-curricular  activities  and  of 
work  outside  of  school.     The  general  point  is  that  inferences 
about  the  effects  of  high  schools  on  students  are  necessarily 
limited  if  analysts  do  not  have  data  on  students  that  preceeds 
the  entrance  of  the  students  into  high  school. 

A  related  substantive  arguement  has  to  do  with  our 
collective  lack  of  knowledge  about  the  experiences  of  students  in 
the  middle  school  years  —  grades  6th  through  9th.    With  the 
exception  of  the  lEA  studies (which  are  very  erratic)  and  the  13 
year  old  samples  from  NAEP  (also  erratic,  cross-sectional  and 
only  recently  contdining  much  school  and  ceacher  data)  we  have  no 
systematic  data  on  the  experiences,  quality  of  schooling  and 
achievements  of  middle  level  school  students.     If  the  new  high 
school  longitudinal  survey  were  started  in  the  7th  or  8th  grade 
we  would  gain  considerable  data  about  the  middle  school  years, 
the  transition  between  middle  and  high  school  and  get  a  more 
complete  picture  of  the  high  school  than  we  had  previously. 

There  are  substantial  issues  having  to  do  with  cost,  time, 
and  comparability  of  date,  sets  which  would  have  to  be  resolved 
for  a  program  of  research  like  this  to  be  undertaken.  Major 
among  these  are  the  various  routes  that  students  take  from  middle 
level  to  high  schools  and  the  costs  of  tracking  students.  My 
sense  is  that  there  are  a  variety  of  strategies,  that  could  be 
developed  to  gain  information  about  efficient  ways  of  collecting 
middle  to  high  school  data  —  maybe  a  small  working  conference 
would  be  useful  to  do  some  preliminary  planning  on  this  issue. 

6) .  Consider  estab  ishina  a  systematic  research  program 
coordinated  with  Healtih.  Labor,  the  Census,  NSF  and  HUD,  This 
proposal  stems  from  two  motives.    First,  I  am  sure  that  there  are 
inter-governmental  coordination  committees  that  meet  every  two 
months  to  share  information  to  help  all  interested  parties  in  the 
government  stay  abreast  of  the  latest  amd  most  effective  methods 
of  data  gathering  and  analysis.    I  am  equally  sure  that  although 
these  committees  are  sometimes  very  effective  that  a  lot  more 
coordination  could  be  done.      Second,  I  am  confident  that  there 
are  a  substantial  number  of  ideas  in  the  field  about  ways  of 
improving  data  gathering  and  analysis  strategies  that  could  use 
some  stimulation  and  direction  and  could  provide  great  savings  to 
the  federal  government  in  the  very  near  future.    On  the  data 
analysis  front  I  have  in  mind  as  examples  the  matching  strategies 
recently  examined  by  Rubin  and  others  amd  the  modeling  estimation 
techniques  proposed  by  Heckman.    On  the  sampling  and  data 
collection  side  the  BIB  spiraling  approach  developed  by  ETS  to 
collect  NAEP  data  is  a  recent  example.  Strategies  for  collecting 
indicators  represents  another  area  that  requires  systematic 
research. 

In  my  experience  one  of  the  best  ways  to  get  agencies  to 
share  expertise  is  to  involve  them  in  a  collective  activity.  Of 
course  the  activity  has  to  be  in  an  area  of  concern.    And  it  has 
to  require  some  committment  of  resources  from  each  agency.  A 
joint  research  program  among  the  primary  data  gathering  offices 
of  each  of  five  or  six  agencies  such  as  Labor,  the  Census,  HUD, 
the  Health  statistics  office  and  NSF  could  be  carried  out  with  a 
modest  contribution  (say  $200K)  from  each  agency  for  each  year. 
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This  would  put  $1  million  in  the  field  to  directly  address 
problems  that  would  make  the  efforts  of  the  agencies  more 
effective  and  efficient.     I  suspect  it  would  also  lead  to  greater 
communication  among  agencies  in  data  collection  and  analysis 
strategies.     It  might  also  lead  to  s  greater  understanding  among 
the  various  agencies  about  the  nature  and  content  of  data 
collected  by  other  parts  of  the  government. 

7) .  Consider  carefully  how  to  coordinate  research  and  statistics 
within  the  Department  of  Education.    Over  the  13  years  of  NIE's 
existence  there  has  been  little  systematic  cooperation  between  it 
and  NCES-     In  the  past  six  months  this  may  have  changed.  At 
first  blush  my  sense  is  that  greater  cooperation  between  the 
agencies  and,  indeed,  systematic  coordination  of  research  funding 
and  the  gathering  and  analysis  of  statistics  would  be  of  great 
benefit  and  little  cost.  Such  coordination  might  lead  to 
combining  the  functions  under  a  single  Director.  As  far  as  I 
know,  however,  the  research  and  statistics  gathering  and  analysis 
functions  are  separated  in  other  departments  of  the  federal 
government.     This  may  be  due  to  the  fact  that  the  constituent 
communities  are  different,  each  wanting  their  own  small  agency. 
Or  it  might  be  due  to  a  desire  to  separate  research  from  the 
on-going  policy  orientation  that  the  statistics  agencies  often 
have.    Neither  of  these  reasons  appear  compelling  to  me  but  there 
may  be  other  reasons  to  keep  research  and  statistics  at  arms 
length  from  each  other.    With  the  NIE  being  reauthorized  and 
organizational  changes  to  OERI  being  proposed  internally  it  seems 
to  be  a  proper  time  to  think  through  this  issue. 

END 
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Introduction 


In  response  to  a  request  by  the  National  Center  for  Education 
Statistics,  this  paper  will  address  specific  and  general  Issues 
regarding  data  needs  and  considerations  that  might  improve  and  better 
facilitate  the  collection,  use,  and  Interpretation  of  educational  data 
at  the  elementary  and  secondary  school  levels.  The  Issues  discussed 
will  range  from  preschool  education  to  the  transition  of  students  from 
high  school  to  college.  While  the  matriculation  of  students  from  high 
school  to  the  world  of  worJc  Is  ac'jiowledged  as  an  important 
transitional  points  research  and  data  Issues  regarding  school -to-work 
will  not  be  discussed.  The  reason  Is  that  the  author's  primary 
experiences  and  contributions  concern  the  process  of  schooling  and  the 
matriculation  and  transition  of  students  at  various  points  In  the 
educational  attainment  process. 

Seven  specific  Issues  will  be  discussed.  These  Issues  will 
address  data  needs  and  J&eaaures  based  on  the  students  and  schools  as 
the  units  of  analyses.  Host  educational  data  collection  activities  at 
the  elementary,  secondary,  and  pofttsecondary  levels  have  concentrated 
largely  on  obtaining  student->level  data  (i.e«f  student  achievement, 
aspirations  and  expectations) «  Bowevert  there  Is  a  critical  need  to 
better  understand  the  process  of  schooling  and  other  structural 
components  of  elementary  and  secondary  education  that  are  associated 
with  and  Influence  various  student  outcomes.  Thus,  In  focusing  on 
both  students  and  schools,  the  need  for  Improving  past  and  present 
data  collection  activities  and  suggestions  for  new  data  will  be 
discussed.    Alsot  rather  than  describe  specific  questionnaire  Items  and 


ERLC 


Beasures,  tht  discussion  will  raise  questions  and  address  issues 
around  which  measures  can  be  developed.  Ttitst  issues  are  as  follows: 
praachooling  and  aarly  education,  aleaentary  and  secondary  school 
tracking,  student  attrition,  quality  of  schools  aurvty,  teacher  and 
parant  gurvays,  aaaeaaing  student  attitudes  toward  schoola  and 
learning,  and  the  transition  of  students  froa  high  school  to  college* 


An  iBportant  issue  regarding  early  childhood  education  concerns 
the  nature  and  effects  of  preschool  education  (both  formal  and 
informal).  Several  questions  should  be  raised  and  addressed  by  data 
in  this  regard.  Plrst»  what  percenUge  of  taerican  children  to  not 
participate  in  preschool  education,  and  wby  don*t  tbey  participate? 
What  is  the  co^kosition  by  race,  sex,  end  social  class  of  children  who 
do  participate  in  prescbool  education?  Secondly,  what  is  the  nature 
of  preschool  education,  end  bM  structured  end  centralised  are 
preschool  curricula?  Thirdly,  what  are  the  background  characteristics 
and  quality  of  prescbool  teacherai  and  to  what  extent  do  they  differ 
fron  those  of  eleaentary  and  secondary  school  teachers?  fburth,  and 
•ost  iaportantly,  what  are  the  effects  of  preschool  education  on 
student  learning  and  eleMntary  and  secondary  school  education? 

lleBentarv  and  Secondary  School  Tracking 
In  Boat  national  surveys  that  have  included  aeasures  on  school 
tracking,  data  have  been  obtained  at  the  high  school  level  and  have 
been  priaarily  derived  froB  students,  or  froB  school  records.  These 


Preschooling  and  Early  Education 


521 


ERIC 


«n   th.   tvp*  Of  high  •cbool  programs  that 
dau   antail   Information  on   tha   typa  os   »  * 

^  o,  «.dU.  «>.y  "V.  ..rn.a  in  co""..  -=-..«• 

t..  »nc.pt  .na  «n..^.»=..  o.  ««  ^^.o-  «.« 

lt.i»a  ..-u«.  »'"• 

».rt   fro.  hi*.  ««o»  °" 

,.tt.t»  in  .i-.nt.nr  .na  ..~na.n,  .ii-i  »..^'- 

«lral„         a.t.11.*  '.t.  on  U..  typ.  Of  «».«.  .t-a.nt. 
,..p.ciai,  in  -U.-.tl..  .na  .=l.n=..  -lU  - 

f«na  t«t  sa* 

..^n»  U«  U  ..  ^»  cMtid  for  » 
.o  " 

„„„..  «..t  tM,  t.».  ...U..  m,.  ..rnr-n.  ««. 
,inai,.  ln.tituti«..l  «  .^0,1  .r.  .-a-  « 

...  t.  «.loa.  el"«.        •'••'•^  "  •  • 

.auction.  ,ift.^  -a  «I.n«a  pro,.-.  «  *.»=t.ri.tic. 
.na  ^UfiCion.  of  U»  «..h.r.  «.t  .r.  -i^  "  0>...  .l-M- 
and  prograu. 

m*..,AMf^t^  ittttitlon 

.nd  astanaiv*  data  on  atudant  attrition 
Obtaining  "ora  accurata  and  aKtanaivw 

AmtM  naad.    Xn  daacrlblng  tha  lack  of 
pattarna  la  pcaaantly  a  Mjor  daU  ti^- 

ii.*.   eaiiaetlon   aganclaa   that   raport  atudant 
conalatancy   batwaan  data  collaction 

«<!  emabura  a9t5)  notad  that  0.«.  Canaua  and 
attrition  rataa,  CooHa  and  Clnaburg  u» 

522 


NCES  estimates  of  high  tchcx^l  drop-out  rates  vary  aa  auch  as  50 
percent.  A  major  reason  is  the  diffeient  procedures  that  these 
agencies  enploy  in  measuring  attrition.  Thui.  iDore  coordination  araong 
agencies  is  necessary  to  resolve  or  at  least  to  reduce  these 
inconsistencies. 

Othei        ortant  needs  regarding  student  attrition  research  entail 

(1)  having  the  necessary  data  to  docuwnt  attrition  patterns  such 
earlier  in  the  educational  attainment  process  (i.e..  prior  to  high 
school    or   at    the    elementary    and    junior    high    school    level)  and 

(2)  obtaining  more  detailed  information  on  student  drop-outs  at 
various  educational  points.  For  example,  such  data  should  include  the 
race,  sex,  and  social  class  background  of  student  drop-outs ,  their 
records  of  academic  achievement,  their  attitudes  toward  mchool*  the 
reasons  that  they  dropped  out  of  school  #  and  whether  they  expert  to 
resume  their  schooling.  Also,  better  data  on  student  ua-sntry 
patterns  at  various  points  in  the  schooling  process  are  needed. 


ftiality  of  Schools  Survey 
In  rscent  public  documents.  It  has  been  argued  that  the  quality 
of  American  public  education  and#  subsequently»  the  quality  of  its 
students  have  declined  (National  Commission  on  Bccellence  In 
Bducation,  I993t  Coleman,  Boffer,  and  Ulgore,  1982).  Bowever,  more 
detailed  and  comprehenslvm  daU  on  American  public  schools  are  needed 
to  :  tter  assess  these  claima.  Therefore,  the  National  Can^^r  for 
Education  Statiatiea  ahould  seriously  consider  undertaking  a  atudy  of 
the  nation *s  elementary  and  aecondary  public  achoola.     Xn  doing  aor 
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••v*ral  issue,  might  b.  addressed.    For  example,  one  lm;wrUnt  Issue 
eoncerns  diffar.nce.  b.t«..n  .chool.  not  :.nly  In  th.  »arlnu*  aUt.s. 
but  also  between  achools  within  any  given  state.    An  a.jesiaent  should 
be  aade  both  of  the  us?«  of  standardlied  test.  In  elementary  and 
seoondary  «:hool.  and  of  the  differences  and  similarities  In  grade 
promotion   and   high   school   graduation   requirements   from  one  school 
•ystea  to  anothar.    ftlll  «K>th«r  issue  concarna  the  natura  of  achool 
eurlcula    and    the    laarnlng    proeass    In    elementary   and  aecondary 
•choola.     in  commenting  on   both  of   theae    featurea,    the  national 
commission  on  ftcellanc.   In   Bducatlon    (1983)   noted   that  -condary 
achool  curricula  In  tear  lean  public  acboola  have  become  too  diffuse 
«id   that   atudent.   arm  not   being   Uught  the  higher-order  thinking 
akllla  naceasary  for  auccaaaful  problem-K»Wing.    Therefore,  data  on 
the  type  of  currlcuU  and  Uachlng  and  learning  paradigm,  that  are 
•mployad   in  different  wboola  and  elaaaea   (l.a..  «»demlc.  special 
•dueatlon,  ate.)  rtould  ba  uMful. 

Data    that   woal6   par«lt   a   oom>aratl^   ..aeaame^t   of  achool 
anvlronmant.  and  atudent  •cblevea.nt  in  private  ver.u.  public  achool.. 
and  in  pr«Jo-lnantly  Macit  irtrw.  pr«Io.inanUy  •hit.  .l—ntary  «d 
aecondary  achool..  ar.  al«.  naadad.    th.  latter  data  will  facilitate 
an    .valuation   of    the   «tant   to   which   achool   da.egregatlon  baa 
increaaad    .ducation.1    opportunity    and    attaln^nt    for  -Inorlty 
atudent..    Alw.  th.  internal  condition,  of  da.agregatad  «:hool.  In 
term,  of  race  relation,  and  the  a.tant  to  which  reaegregatlon  patterr.. 
•Klat  among  atudent.  within  «:hool  cla.aroo..  and  In  extracurricular 
actlvltle.  ne«S  to  b.  .ica.ln«l  based  on  .or.  ayatematlc  daU  at  the 
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elementary  and  secondary  school  levels.  In  additiont  data  on 
eurrlculuTD  differences^  school  facilities,  and  the  characteristics  and 
quality  of  teachers  and  studsnts  in  public  and  private  schools  are 
needed  to  reassess  the  findings  by  Coleman  et  al  (1982)  concerning  the 
superiority  of  private  schools  over  public  schools,  k  more  useful 
inquiry  vould  entail  identifying  the  elements  of  private  school 
education  that  might  bm  useful  in  improving  public  education. 

Ttacher  and  Parent  Surveys 

Another  important  aspect  of  school  quality  is  teacher  quality* 
Ihust  given  the  dearth  of  data  available  on  teacher  quality  and 
teacher  performance,  a  separate  survey  on  teachers  (both  public  and 
private)  needs  to  bm  conducted.  Xt  has  bemn  recently  reported  that 
too  many  public  •lementary  and  secondary  school  teachers  are  being 
recruited  Izam  the  bottom  quarter  of  high  school  and  college 
graduating  classes  and  that  there  is  a  severe  shortage  in  the  number 
and  quality  of  high  school  mathematics  and  science  teachers  (Hational 
Coomiission  on  bcellence  in  »Sucation#  1983).  These  cUims  nsed  to  be 
bstUr  validated  by  aiore  detailed  and  systematic  daU.  In  addition, 
information  on  Uacher  salary,  teacher  attitudes,  and  teacher 
motivation  are  neaded* 

Data  about  the  parents  of  elementary,  junior,  and  senior  high 
school  students  are  also  needed,  these  data  should  assess  the  extent 
of  parental  involvement  in  achoolst  the  values,  attitudes,  and  extent 
of  familiarity  that  parents  have  about  schools;  and  parents* 
perceptions  of  the  type  of  education  that  their  children  are  or  are 
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not  obtaining.  National  data  on  thate  issues  art  not  available.  To 
assure  the  participation  of  low-incoat  faailita  in  collecting  these 
data,  survey  efforts  should  be  augsMted  by  hone  interviews  of  a 
selected  sasple  of  these  families. 


Aswlnq  Student  Attitudes  Tbward  Schools  and  Uarninq 

OaU  on  students*  attitudes  about  schools  and  their  education  are 

very  linited  and  critically  needed,    in  oonaenting  on  the  iaportance 

of   such  data,   sMbers   of   the  Study  Group  on   the  Ctonditions  of 

ficcellence  in  taerican  ligher  Iducation  (1984)  noted  the  following: 

An  institution  that  regularly  se^ks  its  students*  views  about  the 
quality  of  their  education  experience  is  unifesting  a  very 
different  set  of  values  froi  an  institution  that  aakes  no  such 
inquiries  once  the  student  ■atriculstes.  If  the  only  subjocts  on 
which  we  call  for  student  opinion  are  extracurricular  activities, 
athletics,  and  food  service,  we  leave  the  iapression  that  we  do 
not  value  studenU  as  people  capable  of  thinking  seriously  about 
their  education,  (p.  CI) 

Thus,  acre  deUiled  and  longitudinal  student  attitudinal  data 
that  extends  beyond  students*  self -concept  and  their  educational  and 
occupational  expectations  are  needed.  This  information  should  be 
obtained  froB  high  school,  as  well  as  junior  high  school,  students  who 
should  also  be  capable  of  providing  useful  Inforaation  about  their 
education. 


The  Transition  of  Students  frpa  High  School  to  College 
The   transition  of  students  froa  high  school  t  ~  college  is  a 
critical    point    in    the    educational    attainment    process  (Thomas, 
Alexander   and   lekland,    1179).     Fresent  surveys   sponsored  by  NOBS 
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(i.t.,  the  National  Xiongitudinal  Survey  of  High  School  Senlor«-l972; 
High  School  and  Beyond)  perxDit  rough  tstinates  of  student  transition 
rates  froa  high  school  to  college  (i.e.f  two*year  vs.  four^year; 
predominantly  black  w.  predoainantly  vhiU)  •  However,  additional 
and/or  better  data  on  the  selectivity  of  the  postsecondary 
institutions  that  students  attend f  the  type  of  financial  aid  that 
potential  college  atudents  recaivet  and  the  raarons  that  atudents 
select  various  types  of  colleges  are  neaded* 

AlaOf  sore  extensiva  data  on  present  trends  in  higher  education 
cost  and  student  finance  of  higher  aducation  are  neaded*    Xt  has  been 
recently  reportad#  for  exaaple,  that  students  are  increasingly  relying 
on  loans  rather  than  grants  and  acholarshipa  lor  their  poatsacondary 
C  aducation    (Miller,    19S5)    and    that   adueational    indebtadnesa   is  a 

priaary  reason  that  aany  diaadvanUgad  ainority  atudanta  are  not 
presently  attending  four-yaar  collages  and  graduate  and  profeasional 
schools  (Flaner,  loreh,  and  Davis,  1982).  Thus,  national  and  atate 
data  that  vould  parait  an  aaaessment  of  tranda  in  tha  availability  and 
packaging  of  atudant  aid,  aa  wall  aa  the  af facta  of  varioua  typaa  of 
aid  on  different  typaa  of  atudanta,  ahould  be  uaeful. 

Other  lasuea 

Ibur  additional  iaauea  regarding  the  collection  of  future  data 
ahould  be  noted  in  ooncluding  thia  discussion*  The  firat  ooncerns  the 
need  for  acre  accurate  and  conaistent  aaaaurea  of  aajor  variables  and 
dafinitiona  of  ainority  groupa  aaployad  in  educational  aunreya.  Cook 
and  Ginaburg  (19SS)  have  adequately  describad  the  aevare  problem  of 
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Fourth  and  finally,  a  aajor  priority  should  be  established  by 
NCES  to  continue  and  extend  longitudinal  data  collection  efforts. 
Such  data  will  continue  to  be  critical  in  studying  schooling  processes 
and  student  acbieveaent  and  atUinaent  over  time*  NCES'  National 
Longitudinal  Survey  (NI5)  of  high  school  seniors  was  a  aassive  and 
important  investment  that  should  be  continued  and  extended  by 
subsequent  follow*upa«  One  immediaU  and  important  need  that  a 
subsequent  follow-up  of  the  ni£  might  serve  entails  a  study  of  the 
process  and  experiences  of  students  in  U.S.  graduate  and  professional 
schools.  Alsor  applying  and  consistently  maintaining  a  longitudinal 
approach  to  the  current  program  that  NCES  is  proposing  (especially 
given  a  focus  on  pre-faigb  school  and  early  education)  should  prove 
•xtremely  waluable  in  filling  many  of  the  existing  voids  in 
educational  policy  and  research. 
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COMMENTS  ON  AN  ELEMENTARY  AND  SECONDARY  EDUCATION  DATA  PROGRAM 


Brendo  J*  Turnbuli 
Policy  Studies  Associates 


The  National  Csntar  for  Education  Statistics  dssarvss  crsdit 
for  undertaking  •  fundamsntsl  rsdssign  of  its  data  program 
in  slspsntary  and  secondary  education.     Zn  this  paper*  Z  suggest 
that  NCES  use  this  opportunity  to  (1>  analyze  likely  uses  of  the 
infornation  it  collects  and  disseminates*   (2)   launch  more 
detailed  investigations  of  educational  inputs  and  processes*  0> 
take  some  steps  to  place  findings  on  educational  outcomes  in 
context*  and  <4>  continue  to  etteck  the  problem  of  quality 
control • 

First*  a  word  about  my  vantage  point  is  in  order.     I  am  a 
researcher  who  collects  and  analyzes  informetion  ebout  state 
and  local  implementation  of  programs  for  special-needs  students 
and  for  educational  quality.     Z  try  to  draw  from  this  information 
the  types  of  conclusions  that  can  help  policymakers  assess  and 
modify  programs.    Thus  Z  have  a  bias  toward  the  information  that 
policy  audiences  will  use.     I  also  like  to  see  detailed 
information  about  what  goes  on  in  schools*  which  is  not  always 
conveyed  by  gross  measures  of  the  resources  put  into  schools. 
Finally*  because  ay  familiarity  with  NCES  ie  only  that  of  an 
occasional  user  of  its  data*  this  paper  may  recommend  aome 
procedures  that  are  already  standard  practice  at  the  agency.  Z£ 
so*  please  consider  those  comments  endorsements  rather  than 
recommendations . 


Addressing  the  Meads  ef  Information  Users 

Zdeelly,  the  collection  of  data  should  be  driven  by  a 
framework  of  questions  that  the  data  will  be  used  to  answer. 
Working  backwards  from  intended  uses  through  projected  analyaea 
to  the  specification  of  data  elements  and  methods  of  collecting 
them  would  result  in  an  efficient  and  practical  program.  Zn 
rsality,  NCES  has  to  live  with  uncertainty  about  the  questions 
that  will  be  possd.    However*  there  are  aeme  ways  of  reducing 
this  uncertainty*  in  addition  to  soliciting  advice  through 
commissioned  papers  and  hearings.     Analysis  of  information 
nssds  could  include  the  following  approaches: 

o        Identifying  and  classifying  the  concerns  about 

elementary  and  secondsry  educstion  recently  expressed 
by  important  groups  such  as  Congrsss*  governors*  state 
legislators*  and  the  public. 

o        Doing  a  content  analysis  of  rscent  reports  and  rsform 
propossls*  looking  for  both  the  indicators  that  have 
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conviriC«d  th«ir  authors  of  th«  poor  health  of  the 
•ducation  antarprxsa  and  tha  types  of  improvements  in 
procese  and  outcomes  that  they  believe  their 
recommendations  could  produce • 

o        Drswing  snslogies  in  educstion  to  the  statistics  and 
indexes  that  are  used  in  other  fields*  such  as  the 
gross  nstionsl  product*  measures  of  housing  starts* 
and  the  like* 

Classifying  ths  concerns  of  various  constituencies 

One  guide  to  the  future  interests  of  policymakers  and  the 
public  is  whst  they  hsve  ssid  sbout  educstion  in  the  recent  psst* 
since  these  groups'  concerns  remain  reletively  stsble  over  time. 
The  Csllup  poll  consistently  shows  that  the  public  ia  concerned 
about  diacipline  in  their  local  schools*  for  exsmple.  The 
members  of  Congress  for  whom  the  educstionsl  opportunities  of 
special*needs  pupils  hsve  been  an  important  concern  are  not 
abandoning  their  interest  in  these  pupils.     Governors  and  atate 
legislstures  will  remsin  concerned  thst  their  states  offer 
employers  s  skilled  %#orkforce. 

All  these  concerns  csn  bm  trsnslsted  into  indicstors  that 
are  worth  collecting  on  e  nstionsl  scsle.    Citizens'  worries 
ebout  discipline  suggest  thst  it  would  hm  useful  to  hsve  data  on 
the  frequency  of  various  types  of  incidents  in  schools  over 
time.    Becsuse  the  •ducstion  of  sp#cicJl«needs  groups  remaina  an 
isaue  in  federal  policy*  data  on  educational  reaourcea* 
proceaaes*  and  outcomea  should  be  broken  dowr«  by  type  of  pupils 
wherever  possible.     The  skills  of  entry*level  workers*  besides 
being  s  stste  concern*  deserve  some  snalysis  on  a  nstionsl  acale. 

Even  aome  concerns  thst  sre  primsrily  local  csn  provide 
clues  to  dsts  that  ere  worth  collecting  nationally.  Local 
adminiatrators  routinely  collect  and  often  uae  data  on  atudent 
attendance*  the  popularity  of  particular  courae  offeringa*  and 
turnover  among  teachers  and  sides.    Collscting  some  sort  of  dsta 
on  matters  such  as  these  might  be  fessible  and  worthwhile  on  a 
national  acale  aince  theae  topics  reflect  legitimste  concerno 
sbout  the  workings  of  school  systems. 

Analvzina  the  indieatorm  cited  in  recent  reports 

Whst  evidence  hss  recently  convinced  the  public  end  the 
medis  thst  educstion  in  the  United  Ststes  is  in  ssd  shspe  (to  the 
extent  thst  the  flurry  of  enthusissm  for  refora  hss  been  bssed  on 
evidence)?    An  snslysis  of  the  indicstors  in  which  the  authora  of 
the  reform  reporta  have  found  cauae  for  gloom  and  thoae  in  which 
they  urge  improvement  could  provide  another  aource  of  ideas  for 
daLa  collection.     The  report  authora*  along  with  the  preaa  and 
televiaion*  auceeeded  in  making  a  caae  to  the  country.     The  typaa 
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of  evidence  they  used  mght  reaeonabiy  be  expected  to  make  sense 
for  future  information  users*   too»   if  collected  on  e  continuing 
basis. 

Thxs  does  not  mean  that  every  fact  or  impression  cited  in 
the  rush  to  condemn  and  uplift  the  schools  deserves  to  be 
formalized  as  part  of  the  Common  Core  of  Data»  naturally.     One  of 
NCES's  responsibilities  should  be  to  place  the  more  sensational 
findings  in  context.     For  example^  comparisons  of  achievement 
in  the  United  States  and  other  nations  ought  to  be  viewed 
alongside  other  measures  that  help  to  balance  and  explain  them, 
such  as  data  on  the  proportions  of  children  in  various  countries 
who  attend  college  or  reach  the  age  of  16  with  the  qualifications 
for  college  admission.     The  point  is  that  if  internationaJ 
comparisons  (and  other  types  of  evidence  on  the  health  of  our 
schools)  have  persuasive  force  for  the  public*  then  they  ought  to 
be  drawn  and  presented  in  a  way  that  is  mm  technically  defensible 
as  possible. 

Drawino  analogies  to  j>ndieators  in  other  fields 

Although  statistic  ^  on  education  are  not  going  to  be  watched 
as  closely  es  those  on  the  economy »  some  ways  of  collecting  and 
reporting  economic  date  may  provide  useful  models  for  NCES.  For 
example*  the  ind^x  of  leading  economic  indicators  snd  data  on 
housing  starts  both  provide  clues  to  the  heslth  of  the  economy* 
and  they  are  especially  useful  becsuse  they  provide  current  data 
that  tend  to  predict  future  developments.     A  concerted  effort  by 
NCES  to  develop  end  publi.cize  enalogoue  date  could  servo  the 
worthwhile  purpose  of  giving  observers  of  the  education  syst<>m 
something  to  look  at  besides  test  scores. 

Data  exist  on  the  number  end  characteristics  of  college 
freshmen  considering  careers  in  teaching*  for  example.  These 
data  could  be  publicized  as  sn  snnusl  signsl  sbout  coming  changes 
in  the  teaching  force.     It  might  elso  be  possible  to  aggregato  a 
number  of  measures  of  •ducstionel  schievement  end  ettainment  into 
en  index  like  the  gross  netionel  product.     Such  an  index  would 
oversimplify  matters*  of  course*  but  so  do  the  economic  indexes 
in  widespread  use. 

In  summary*  measures  of  educational  trends  that  are 
intuitively  easy  to  understend*  thst  cepture  changes  in  several 
important  dimensions  at  once*  or  thst  tend  to  predict  future 
changes  could  meet  some  informetion  needs  of  the  public  and 
policymakers.     If  they  were  releesed  with  some  fanfare  and 
accompanied  by  clear  explsnstions*  they  might  slso  help  educatm 
people  about  what  goes  into  educetional  quality.     Analysis  of 
various  groups'  concerns  about  education  snd  the  data  they  have 
found  persuasive  in  the  pest  can  slso  help  guide  the  development 
of  such  measures. 
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Describing  Educational  Inputs  and  Processes  Hor#  Fullv 


Alfred  North  Whitehead  said*  **b>ek  exmpl ici ty»  and  distrust 
it.**    Large*scale  data  collection  is  especially  useful  when  it 
produces  descriptive  data»  and  simple  descriptions  of  such  things 
as  the  demographic  characteristics  of  students  and  teachers  are 
very  useful  for  researchers^  policymakers^  and  the  public.  On 
the  other  hand*  broadly  based  surveys  aimed  at  describing  what 
goes  on  in  schools  run  a  serious  risk  of  producing  bad 
information.     Ky  experience  in  schools  suggests  that  resources 
often  go  unused  or  ere  used  in  unexpected  ways.  Hy 
recommendations*  therefore*  ere  twofold: 

o        Do  not  underestimate  the  value  of  the  eimplest 
demographic  statistics. 

o        In  the  effort  to  describe  more  complex  educational 

resources  and  processes*  probe  beneath  the  surface  for 
detailed  data  on  exactly  who  does  what  with  what 
resources. 

Th^  value  of  eimple  etatimtiea 

NCES  publications  already  contain  the  types  of  simple* 
factual  date  that  are  indispensable  in  compiling  a  portrait  of 
the  education  system.     Data  on  the  characteristics  of  students » 
teachers*  schools*  end  school  systems  provide  a  sense  of  trends 
in  education  end  important  background  variables  for  analysis  of 
developments  et  the  national  and  state  levels.     Time-series  data 
represent  a  unique  resource  for  research  end  policy  analysis*  and 
the  federal  government  is  particularly  well  qualified*  by  virtue 
of  xta  centrality  end  visibility*  to  collect  such  data. 

The  value  of  demographic  end  other  descriptive  data 
increases  greatly  when  the  data  are  collected  and  summarized  in  a 
consistent  wey  from  year  to  year*     When  a  measure  changes*  the 
trends  it  is  intended  to  capture  can  be  exaggerated  or  masked. 
Therefore*  even  when  there  seema  to  be  good  reason  to  tinker  with 
a  question  or  en  index*  the  potentiel  improvement  should  be 
carefully  weighed  egeinat  the  loss  of  comparability.  Stability 
in  measures  should  «#in  out  in  moat  ceaea. 

The  urge  to  improve  on  existing  data  can  fi;;d  e  useful 
outlet  in  extending  dete  collection  to  new  areas.  Early 
childhood  education  end  other  child«*care  settings  are  en  example 
of  such  en  eree*  where  new  developments  ere  occurring  Cand 
policymakers  may  eventually  see  a  need  to  catch  up). 

Finally*  when  descriptive  dete  heve  been  collected*  they 
should  be  published  ss  rapidly  as  possible.     Because  delays  in 
publication  reduce  the  usefulness  of  data*  the  Department  of 
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Education  should  •xp«dxt«  whatever  stsps  or«  n««d«d  for  clearance 
and  quality  control* 

Heaaurinq  rsaourca  umm  and  program  eharacterxatlca 

Ovar  tha  past  fiftaan  yaara  or  ao»  avaluationa  and  othar 
atudiaa  of  aducational  prograaa  hava  grown  far  mora  aophiaticatad 
bacauaa  of  tha  racognition  that  a  program  may  axiat  on  papar  and 
yat  aaka  liaitad  or  unpradictabla  diffarancaa  in  claaarooa 
practxca.     Thia  problaa  of  iaplamantation  daaarvaa  analyaia  aa 
it  appliaa  to  tha  work  of  NCES.     Although  I  arguad  abova  for  aoaa 
ov^raiaplif iad  indicatora  that  will  aaat  tha  public' a  information 
prafarancaa,  Z  alao  baliava  that  aoaatimaa  a  aimpla  maaaura  of 
aducational  raaourcaa  ia  woraa  than  no  maaaura.     Soma  atatiatica 
giva  a  mialaading  pictura  of  what  goaa  on  in  achoola,  and  for 
aalactad  iaauaa  tha  axtra  cara  and  axpanaa  of  gatharing  accurata* 
datailad  information  will  ba  worthwhila. 

A  topic  that  haa  racaivad  racant  attantion  ia  that  of 
microcop^putar  purchaaaa  and  uaa  in  achoola.     Local  nawa  faaturaa 
oftan  raport  how  many  achoola  **hava  computara**  or  da«criba 
paranta'  fund-raiaing  afforta  to  buy  ona  or  two  aicrocomputara 
for  a  achool*     Tha  adminiatratora  aaam  to  hava  corractly  judgad 
that  thay  would  racaiva  aa  much  public  cradit  for  buying  ona 
aachina  aa  fifty.     NCES  ahould  not  fall  into  thia  trap,  howavar. 
Tha  1984  adition  of  Tha  Condition  of  Education  uaafully  raporta 
on  how  atudanta  uaa  microcoaputara  and  Itow  many  minutaa  tha 
avaraga  atudant  Uk^ar  apanda  with  tham  aach  waak*    Hith  tha 
addition  of  aoma  numbara  indicating  how  many  atudanta  ara  uaara, 
thia  would  ba  a  good  aummary  of  tha  kay  information  about 
microcomputar  uaa*     It  might  ba  avan  mora  uaaful  if  it  wara 
•upplamantad  with  aoma  data**avan  anacdotal  data**illuatrating 
tha  typaa  of  uaa  aummarizad*     What  ia  covarad  in  couraaa  in 
computar  litaracy,  for  axampla? 

Innovativa  tachnology  ia  not  tha  only  araa  in  which  tha 
datail«  of  raaourca  uaa  daaarva  acrutiny*    Tha  numbar  of  taachara 
raportadly  praaant  in  a  diatrict  or  achool  may  not  tranalata 
diractly  into  maaaur«a  of  elaaa  aiza  or  avan  of  tha  actual 
taaching  forca*     Not  only  do  aoma  taachara  mova  around  tha 
building  taaching  laaaona  in  muaic  or  art»  but  aoma  of  tham  navar 
inatruct  atudanta*    Thay  ara  raaourca  taachara#  aaaiatant 
principala  (in  nama  or  in  fact>#  or  managara  of  catagorical 
programa*     Z  mat  aavoral  of  thaaa  nontaaching  taachara  whan  I  did 
fialdwork  on  Titlo  Z  of  tha  Elamantary  and  Sacondary  Education 
Act*     Zn  aatting  up  tha  intarviawa#  Z  had  aakad  to  aaa  Titla  I 
taachara;  aavaral  principala  arrangad  for  ma  to  maat  with  paopla 
who  hald  taaching  cartificataa  and  wara  countad  on  tha  building 
roatar  aa  taachara  but  navar  workad  with  atudanta  othar  than  to 
taat  tham* 
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In  addition  to  gath.rxng  .or.  detailed  data  about  the  u.e  of 
particular  r.aourc.a  in  achoola.  NCES  Might  prob.  more  deeply 
^nto  diicripttonl  of  curriculum.     At  the  secondary  level     we  neeci 
ilt  onIy"irvi%  oJ  the  cour—  that  .tudent.  taK.  but  al.o  .ome 
SHa  ^iJo^ibiriro;  teacher.)  on  the  topic. 

cover     the  relative  empha.i.  giver  to  the.,  topic.,  and  the  texts 
EllmiJUrJ  teacher,  can  furni.h  .i«4l«r  information  on 

re^on  i:t  -./try  tee 

^rltS:  nt":h?:v:::::!'ii:  SrtJoiai  ...ei..ent  of  Educational 
?rogre..  (NAEP)  i.  one  logical  vehicle  for  collecting  the.. 

At  a  further  l-vel  of  d.t.ll,  data  ^•"/"•^"f^iJ^'i^^racy  i. 
.roc...e.  would  be  u.eful  if  .o.e  rea.onable  level  of  accuracy  i. 
proceaaea  J"  "    .       .urveya  could  indicate  how  tiae  i.  u.ed 

^^"ig  :;e  .iVooi  lly  Tr\::  clI..  period,  how  aany  interruption. 
o::r.iS  wJ^J  theee^nterruption.  ar.,  -^^-^^J^J-tiirt" 
group,  and  in  whole-claaa  inatructlon,  what  '^i'^^^Pi^"'^. 

fill  lllor  rol.  in  h.lpin,  to  r.fin.  .ny  .uch  .ur../.. 

Th.  .n.ly.l.  .nd  pr...nt.tlon  of  d.t.il.d  dot.  »"  •='«">1 

^^^^^  ±^t:^^^'^^^  ^ 

^.M.diation  needed  In  collegia  with  different  levela  or 
:IlU"ilJj      B^clul.  of  the  extent  of  variation  in  auch  cour.ea, 
"«rcli  J;  legiti.af  debate  .bout  wheth.r  th.  nationwide 
anrollaent  figure,  aean  anything. 

Koport.  on  eour..  cont.  nt  .nd  :!:~" 

rrpiJi-nc..  Of  p«"=;i:i,:»rs-s«?r.  t«d:nrJUA.n:i;ir 
rcj:;/.rror:cJt:J«::":r"c::^.o..  n.«..  x.n^ 

Engli.h)  could  infora  the  aaaeaaa.nt  .nd  foraul.tion  ot  xea 
policy  for  theae  groups* 

In  au««.ry,  I  would  .rgue  for  the  collection  of  detailed 

data  on  achoola'  re.ource  u.e,  ~"^*="i;"  ~:o':u;h  Stta 
inatructional  proc.e..     The  .Kp.n..  J'^J  . 

collection  well  ...n.  JJ-J.  :,-:\;M:r:^::uci:i::il  practic. 

uieJut"    ;i:y  Co^li  ^u;Sl.:.nt  the  bread  and  butter  of 
;:?"cS:i:nlSi'on'S:r  :::il.r  S.r.cteri.tica  of  atudenta. 
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trachera,  and  echool  •y«tem*--which  ahould  continua  with  as  much 
consistency  over  tlws  as  posaibls. 

!^easurinQ  anr*  Ra^orting  Outcowa 

Undoubtsdly,  isost  of  ths  sttsntion  that  citizsns  and 
polxcysaksrs  gxvm  to  sducation  statistics  will  continus  to  csnt#ir 
on  studsnts'  tsst  scorss.     Psrhaps,  though,  NCES  will  bs  abls  to 
saks  Marginal  contributions  to  o  sors  cosplsts  picturs  of  ths 
outcoms*  of  sducation.     It  can  do  ths  following: 

o        Accompanying  rsports  of  tsst  scorss  with  mors 
dsscription  of  what  was  tsst^d. 


o 
o 


Giving  publicity  to  outcosss  such  ss  sttainssnt. 

Sssking,  using,  and  explaining  ssasurss  of  hi<^hsr- 
ordsr  skills. 


DsscrlbinQ  t^hs  tssta 

Fsports  of  students'  scorss  on  tests  should  be  closely 
accompanied  by  descriptions  of  what,  the  tests  covered.  The 
displsys  of  NAEP  results  in  The  Condition  of  gdueation  indicate 
the  general  categories  of  knowledge  tested,  but  putting  somewhat 
more  detail  on  the  psges  thst  contsin  these  summery  tsbles  and 
graphs  would  be  even  better.     Interested  readers  should  also  hava 
ready  access  to  comparisons  between  the  NAEP  tests'  content  and 
the  content  of  the  stsndardized  tests  that  school  systems 
commonly  use. 

Ideally,  the  medis  and  stste  and  locsl  school  systems  would 
then  foilow  the  federal  lead  and  describe  what  high  and  low 
scorss  mean.     In  sny  esse,  NCES  should  do  so. 

Weas^rino  ether  outcomem 

Education  professionsls  know  thst  test  scores  do  not 
summarize  all  the  interesting  outcomes  of  schooling.     HCES  and 
the  rest  of  the  Department  of  Education  should  not  only  continue 
to  measure  other  outcomes  but  slso  emphasize  them  whenever 
possible.     Cood  messures  of  dropout  rstes — snd  of  the  number  of 
people  who  obtsin  genersl  ^quivslency  degrees**sre  examples  of 
such  outcome  measures.     The  extent  of  voting  smong  recent 
high-school  graduates  is  enother  interesting  statistic  to  have. 

Emohasiginq  h^qher^order  akills 

This  recommendstion  reflects  my  sense  thst  schools  sre 
increasingly  teaching  to  the  tests  devised  by  test  publishers  and 
state  governments,  that  these  tests  tend  to  measure  rather  simple 
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skxlle  such  as  decoding  and  arithmetxc  operation*,  and  that  at 
•oaa  point  there  may  be  a  backlaeh  from  education  prof eeeionale 
or  even  empioyere  who  notice  that  other  outcomee  are  be?ng 
neglected.     Defining  higher-order  ekille  !•  hard^  '•nd  eeaeuring 
them  is  harder^  but  the  attempt  would  be  worthwhile. 

Because  I  have  very  little  technical  knowledge  about 
meaaurementt  my  recommendations  in  this  ares  sre  fairly  general. 
However #  as  a  would** be  consumer  of  data  on  student  outcomes »  Z 
can  advocate  that  NCES  continue  end  perhsps  intensify  its  efforts 
to  place  test  scores  in  context. 


Quality  Control 

Because  all  ststistics  imperfectly  represent  reality,  an 
agency  that  jollects  snd  disseminates  statistics  can  never  do  too 
much  to  identify  their  weaknesses,  correct  the  weaknesses  it  can 
correct,  and  sxplain  the  ones  it  cannot.     NCES  has  a  further 
Challenge  stemming  from  its  relisnce  on  diverse  state  education 
agencies  (SEAs)  to  collect  and  report  standard  datat  Quality 
control  takes  different  forms  ?or  the  collection  of  data  from 
national  samples  snd  the  sggregation  of  state-collected  dsts: 

o        Surveys  of  nationsl  ssmples  will  provide  the  highest- 
quality  deta  on  topics  where  terms  hsve  vsrying 
definitions,  such  ss  ''dropouts,-  snd  their  quslity  csn 
be  improved  if  studies  of  response  bias  ere  built  in. 

o        NCES  should  not  hesitate  to  take  s  strong  stand  with 
SEAs  on  quslity  snd  consistency  in  the  data  they 
provide  to  the  federsl  level. 

rveva  of  natieanal  samples 

Nstional  surveys  like  High  School  snd  Beyond  perform  a 
unique  service  to  r^sesrch  snd  policymsking  in  educstion. 
Although  expensive,  they  provide  relstively  trvstworthy  date  on 
detailed  topics  snd  permit  the  snalysis  of  e  vsriety  of 
educstional  issues  st  the  level  of  the  student,  the  school,  or 
the  community.    Where  inconsistencies  arise  in  stete-level  data 
because  ststes  define  terms  in  different  ways,  national  surveys 
using  standard  definitions  csn  help  resolve  the  resulting 
questions. 

Nstionsl  studies  present  issues  of  response  biae  that  sre 
manageable.     For  example,  we  know  that  students  tend  to  hsve 
erroneous  idess  of  their  parents'  income  levels  snd  thst 
Household  surveys  provide  better  data  on  this  topic.     More  could 
be  done  to  identify  other  sources  of  faulty  dsts  in  nstional 
surveys  so  thst  eiternative  means  of  data  collection  <such  ss 
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different  respondents  or  differently  worded  question.)  can  be 
tried • 


Aggregation  of  state  data 

reliance  on  SEAs  to  provide  data  to  NCES  is  sensible 
rCf.?"!!?  9iven  the  relative  amounts  of  resJCJce. 

available  for  data  collection  In  education  at  the  stote  anl 
federal  levels.     However,  the  problems  resulting  from  poor 
quaUty  control  In  states  or  inconsistencies  across  states  are 
not  entirely  unavoidabl*.     NCES  should  be  wllLing  to  take  a  firm 
stand  on  quality  control.  •  «  xirm 

th.v  Ir"  objective  should  be  for  SEAs  to  recognize  that 

they  are  participating  In  a  process  that  is  centrally  controlled 
ir^^n  Ts,^*'  ""^  national.  Infor.ation  needs  in  a  technically 
JjoZ  spji".rr*  •«-'Pi«.  HCE5  Should  Check  th.  data  received 

froe  SEA.  against  last  ye.r's  data,   look  for  Internal  consistency 

states.  Any  questions  or  problems  should  be  raised  with  the 
state,  and  all  states  should  recognize  that  they  may  have  to 

wrii'IroSrhT  -baissions.     Other  qualitJ-Joit?:!  st^ps 

will  probably  be  necessary  as  well. 

C  I"  ^hls  federal  systea,  Washington  defers  to  state  authority 

on  .any  laaue..     CJdltle.  of  d.t.  collection  .nd  .n.lysls  should 

^!oh??v*!*'"^ ^  believe  that,  although  the  .t.te. 
rightly  gu.rd  th.lr  pr.r-^.tlv.  to  collect  their  own  d.t.  In 
their  own  w.y..  they  .re  prob.bly  .ore  willing  then  MCES  think. 
I^Jm  •  n.tlon.l  d.ta  program  that  maintalna  high 

atandardr.  of  pxofeaaional  quality.     State  official,  m.y  grumble 
.bcut  th.  ^.poaltlon  of  tighter  central  at.ndarda.  but  «o«. 
«  if  i?"  table  in  any  Intergovernmental  endeavor. 

Including  -he  preaent  .y.tem  of  more  loo.ely  controlled 
reporting* 

The  Council  of  Chief  St.te  School  Officer,  can  be  a  major 
ally  in  a  nationwide  effort  to  correct  the  flawa  m  current  data 
aggregation.     Other  .t.te-be.ed  organlzationa.  auch  a.  the 
National  Covernora'  Aaaoclation.  the  National  Conference  of  State 
Leglalaturea.  .nd  th.  Nstlonsl  As.ocl.tlon  of  St.te  Bo.rd.  of 

e  .take  m  good  n.tlon.l  d.t.  on  education.     The  current  procea. 
of  generating  papera.  aummarlslng  their  r.commendatlona.  and 
holding  hearlnga  can  lay  the  groundwork  for  epeclfylng  action 

InllUlTn  "^V^**""  "  SEA.  snd  others  ari  „2t  ^J^^^dy 

engaged  In   levelopln^  auch  ateps.   they  .hould  begin  .oon. 

In  .umm.ry.  .Ithough  NCES  l.ck.  the  poUtic.l  or  leg.l  power 
of  ir'"""  ^V^-"«^  'bout  their  collection  end  analy.i. 

Of  data.  It  can  probably  muater  the  profea.ional  authority  to 
l.prove  the  data  it  collecta  from  atate..     Together  Crththi 
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£urth3r  refin«««nt  of  national  aurvays,  thia  .tanca  on  quality 
control  ahould  go  far  towarda  corracting. tha  waaknaasaa  currently 
viaxbla  xn  natxcral  aducawion  atatiatics. 

(Conclusion:     Sattino  Prioritiaa 

Intarnal  dalibarationa  at  NCES  aa  wall  aa  thia  procaaa  of 
public  coaaant  will  undoubtadly  9«n«rata  aany  good 
Dacxding  whara  to  concantrata  tha  agancy'a  afforta  will  ba  tha 
naxt  problaa.     Although  HCE5  ataff  will  aoon  iaaaraa  thaaaalvaa 
in  nu.aroua  datailad  daaign  iaauaa,  a  focua  on  a  f«  ^^'^j^JiJ^ 
principlaa  will  ba  in  ordar.     I  would  auggaat  that  tha  Jjjhaat 
priority  ba  placad  on  atr^ngthaning  tha  cradibility  of  tha  data 
through  auch  aaana  aa  quality  control  and  conaiatancy 
aariaa.     Naxt  in  i.portanca  would  ba  tha  principla  of  addraaaing 
infor.ation  uaara'  concarna  about  tha  education  ayataa,  aa  baat 
thaaa  can  ba  infarrad  in  advanca.     To  tha  axtant  poaaibla.  HCE5 
aight  than  expand  ita  data  collaction  in  araaa  auch  aa  tha 
datailad  daacription  of  inatructional  raaourcaa  and  procaaaaa. 
Whatavar  principlaa  ara  choaan  aa  tha  kay  onaa,  tha  J'P**"^^*"^.  .  . 
thing  ia  to  concantrata  on  a  aanagaabla  aat  of  prioritiaa  in  thia 
ambitioua  radaaign  af fort. 


552 


540 


Educational  Data  Needs  for  the  Balance  of  the  20th  Centurv: 
Some  Perspectives  on  the  Emerging  Environmental  Context 
(A  Paper  Prepared  for  the  National  Center  for  Education  Statistics) 


Michael  D.  Usdan 
Institute  for  Educational  Leadership 
June,  1985 

This  paper  is  written  from  the  perspective  of  a  generalist  who  is 
concerned  about  the  whole  panoply  of  social r  economic  and  political 
issues  which  in{)act  elementary  and  secondary  education.  The  author  is 
not  a  data  analyst,  nor  does  he  have  particular  expertise  in  the  whole 
area  of  education  data  collection.  The  perspectives  in  this  paper  will 
be  those  of  a  generalist  who  believes  that  the  data  historically 
collected  in  education  have  been  too  isolated  from  other  information 
sources.  MV  contention  is  that  educational  d«ta  in  the  future  should 
DOt-QDl^b^derived  from  schools  and  other  formal  educational  ^nsti- 
tutions^^ut  also  from  other  deliverers  of  educational  or  training 
services  such  as  the  private  sector,  the  milltarv.  voluntary  associ- 
ations  and  the  countless  other  organizations  and  agencies  which  provide 
education  and  training  services. 

Education  must  be  defined  more  genetically  to  consist  of  more  than 
just  schools.  Outcome  oeasures  relating  to  student  performance  should 
be  stressed  and  significant  non*school  centered  social  and  economic 
information  from  a  broad  range  of  data  sources  both  govemmentail  and 
non-governmental  in  origin  must  be  employed  in  efforts  to  explain 
student  achievement.  Definitions  of  students  and  analyses  of  the 
learning  process  should  be  broadened  to  include  recipients  of  educa- 
tional services  in  a  whole  range  of  non-school  settings.  Data  must  be 
packaged  efficiently  and  more  concisely  and  presented  in  ways  that  are 
easily  understood  by  the  lay  public  and  not  just  by  education 
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AS  the  recent  reform  movement  indicates,  political  and  civic 
leaders,  as  well  as  the  general  public,  are  willing  to  support 
increased  funding  for  schools  if  they  are  convinced  that  the  dollars 
expended  are  generating  positive  results.    In  other  words,  there  will 
be  more  dollars  for  education  only  if  there  is  more  education  for  the 
dollars.    This  political  fact  of  life  augurs  an  era  of  accountability 
in  which  schools  in  the  increasingly  competitive  struggle  for  resources 
will  have  to  justify  what  they  do  to  a  nuch  great  extent  on  a 
cost-benef  it  basis.    Unless  the  current  weaknesses  of  national  educa- 
tion  statistic,  are  remedied  and  existing  inconsistencies  and  inaccura- 
cies ameliorated,  justification  of  increased  expenditures  will  not  be 
support ible  or  politically  viable  and  the  necessary  fiscal  support  will 
not  be  forthcoming  in  an  aging  nation  in  which  fewer  than  30%  of  the 
adults  have  their  own  children  enrolled  in  elementary  and  secondary 
schools. 

The  reform  movement  and  the  heightened  interest  of  Governors, 
civic  elite,  and  influential  business  leaders  will  not  last 
indetinitely  and  certainly  will  not  be  .ustained  without  appropriate 
and  supportible  data  that  can  indicate  which  reforms  work  and  which  do 
not.  The  resource.  wUl  not  be  available  to  support  all  of  the  multi- 
ple reform,  being  enacted  in  .tate.  throughout  the  country.  HSJlfififl 
...oi..  ^>ta  thnt  —  n^^^ntativHv  hfttfr  and  romrnrflhlr  within  «d 
iLULm-fltnrn    iff       — ^  ^""'^  ^^^^^^  infllcaUH  ftint  rnn  help  us 

a£hifi.filD«t.2I  The  timing  of  the  NCES  efforts  to 

reassess  in  a  comprehensive  manner  its  data  gatherir.g  processes  could 
not  be  more  propitious  because  of  the  unique  public  policy  .aliency  now 
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being  enjoyed  by  elementary  and  secondary  education  because  of  the 
current  reform  movement* 

Let  us  now  look  at  the  larger  societal  context  in  which  eler.entary 
and  secondary  education  data  issues  must  be  addressed*  Broader  human 
capital  and  adult  learning  issues  adso  must  be  addressed  in  a  rapidly 
changing  and  increasingly  interdependent  social r  political  and  economic 
environment* 

What  are  some  of  the  major  issues  which  will  so  markedly  influence 
our  future  and  have  such  consequential  ramifications  for  all  of  us?  My 
favorite  philosopher  is  Pogo  who  says  that  we  are  surrounded  by  insur- 
mountable opportunities.  I  believe  that  this  is  indeed  the  case  in 
education  where  the  recent  spate  of  nationally  publicized  reports,  as 
mentioned  earlier,  has  given  the  enterprise  positive  "front-burner" 
public  visibility  in  ways  that  have  not  been  experienced  since  the 
Sputnik  era  almost  three  decades  ago.  If  one  accepts  the  old  adage 
that  invisible  politics  is  poor  politics,  then  the  Misting  window  of 
opportunity  should  be  capitalized  upon,  and  education  at  all  levels 
should  remain  part  of  the  "warp  and  woof"  of  major  public  policy  issues 
and  concerns.  Indeed,  some  skeptics  are  fearful  that  the  educational 
balloon  may  be  deflated  as  quickly  as  it  was  inflated  once  the 
political  rhetoric  and  the  freshness  of  the  recent  highly  publicized 
national  reports  and  recently  enacted  state  reforms  have  abated.  A 
growing  number  of  the  nation's  most  prestigious  business  and  govern- 
mental leaders  are  now  espousing  the  inc)ortance  of  education  and  human 
resource  development  to  the  nation's  econooiy  and  comprehensive  reform 
legislation  has  been  enacted  in  states  like  Texas,  South  Carolina, 
Mississippi,  California,  and  Florida  among  others.  Governors  like  Hunt 
of  North  Carolina,  Dupont  of  Delaware,  Robb  of  Virginia,  Alexander  )f 


Tennessee,  Riley  of  South  Carolina,  winters  of  Mississippi  and  others 
have  been  in  the  forefront  of  political  and  economic  efforts  to 
strengthen  the  quality  of  and  support  base  for  education.  Business 
leaders  from  major  corporation^  such  as  IBM,  Control  Data,  American 
can,  Hewlett-Packard,  the  Bank  of  America,  Dow  Chemical,  Proctor  and 
Gamble,  and  numerous  other  representatives  from  the  private  sector 
throughout  the  country  are  becoming  engaged  in  education  and  related 
human  resource  development  issues  in  unprecedented  and  varied  ways. 

Major  national  business  organization!  auch  as  the  Conference 
Board,  the  Committee  for  Economic  Development,  the  Chamber  of  Commerce, 
the  National  Alliance  of  Business,  the  Business  Roundtable,  and  their 
counterparts  Pt  the  state  and  local  levels  are  undertaking 
education-related  activities  or  discussing  the  significance  of 
education  issues  with  unusual  interest  and  even  zeal  in  a  number  of 
cases.  Education  ii  being  viewed  more  commonly  now  not  as  a  consumer 
of  resources  but  as  a  necessary  investment  in  human  capital  and  the 
nation',  aconomic  viability.  IWftantftlMt-Mfl-BUEBfttt-liUl-bfi 

ittatainfid^flifmix-flnly-if  wf  h«v«>  o^iaiitv  ^ntn  rnn  be  used  to 
dinmnitrnrr  thf  r-^-*-»^^<^  ^^^^^  InHrnirrional  ptograms 

lis  manlfei?tfl  ^"  imorOYftf  ■^^"'^^"t  DftrformanCe. 

I  would  Ilka  to  amplify  these  points  by  stressing  a  number  of 
major  issues  which  should  help  to  illuminate  the  kind  of  data  that  will 
be  necessary,  leaving  the  task  of  defining  the  specific  data  to  be 
gathered  and  procedure,  to  be  followed  to  others  more  qualified  than  I 
am  to  discuss  these  matters.  I  hope  that  this  -environmental  scanning- 
will  be  helpful  to  NCES  a.  it  hopefully  identifies  its  data  collection 
strategies  not  in  institutional  isolation  but  within  the  context  of 
complex  issues  in  an  changing  and  interdependent  social  matrix.  These 
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issues  transcer.5  education  £§1  sg  and  will  require  diverse  informa- 
tion that  entails  many  factors  that  are  not  directly  related  to  the 

school  environment. 

Among  these  soirewhat  interrelated  issues  are  (1)  the  need  to 
develop  and  invest  in  human  resources;  (2)  the  implications  of  changes 
in  the  nation's  demogtaphyi  (3)  the  importance  of  reconfiguring  and 
redefining  education;  (4)  the  inf»act  of  technology  on  educational  and 
economic  development;  (5)  the  ramifications  of  an  aging  and  changing 
work  force;  (6)  the  speciai  and  acute  problems  of  urban  and  minority 
youth;  (7)  the  need  to  define  and  achieve  quality  at  all  educational 
levels;  (8)  the  weaknesses  of  foreign  language  instruction;  (9)  inter- 
level  educational  relationships;  and  (10)  the  development  of  an  appro- 
priate federal  role  in  the  shaping  of  educational  policy. 

These  ten  issues,  of  course,  hardly  represent  either  a  compre- 
hensive or  all-inclusive  litany  of  major  concerns.  Some  of  these 
issues  will  be  discussed  rather  extensively,  while  others  will  be 
alluded  to  briefly  or  barely  mentioned.  Collectively,  however,  they  do 
form  the  basis  for  projecting  a  plausible  change-laden  future  scenario 
in  which  education  issues  will  be  of  great  injort  and  policy  decisions 
must  be  predicated  upon  richer  and  more  diverse  and  reliable  sources  of 
information. 

ThA  Nead  to  Pgvelop  and  Tnvgat  in  Human  Resources 

in  the  past  few  years,  the  importance  of  education  has  been 
discussed  in  the  newer  and  broader  context  of  its  central  role  in  the 
collaborative  efforts  that  w.ll  be  necessary  if  the  nation's  economic 
productivity  is  to  be  inproved,  its  relative  economic  decline  counter- 
acted, and  the  erosion  of  its  international  competitive  position 
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arrested*  Education  is  pivotal  to  these  national  concerns  as  is  tne 
growing  awareness  that  education  remains  the  key  to  maximizing  the 
nation's  human  capital  and  economic  development.  Support  for  education 
in  the  business  communityr  for  example,  increasingly  is  being  viewed 
not  as  mere  philanthropy  but  as  sheer  self^intere  rhe  economy  and 
its  needs r  in  other  wordsr  are  the  contemporary  Sputnik  and  serve  as  a 
lever  for  the  support  and  reform  of  the  educational  enterprise.  In 
essence r  the  key  to  education's  new  salience  is  the  society's  need  to 
develop  its  human  capital  at  all  age  levels  with  emphasis  not  just  on 
traditional  school  age  youngsters  and  institutions  but  also  on  the 
large  numbers  of  adults  who  need  retraining  in  a  period  when  the 
econony  is  undergoing  such  wrenching  transformations*  Education^  thenf 
as  mentioned  earlier^  ought  to  be  defined  more  genericeQly  as  consist- 
ing of  much  more  t««an  formal  elementary  and  secondary  schools  or 
colleges  serving  the  younger  segments  of  the  population.  Data  should 
be  gathered  and  shared  between  and  among  the  diverse  educational 
delivery  systems  and  the  isolation  of  schools  from  other  providers  of 
education  should  be  ended,  information  about  successful  teaching  and 
learning  processes  In  other  environments  as  well  as  In  schools  ought  to 
be  ftnalyged  ^nd  di^sgipinated  reciprocally  so  that  there  are  constant 

training  services. 

There  la  a  growing  appreciation  throughout  the  society  that  human 
resourcea  are  the  dominant  factor  accounting  for  growth  in  national 
income  and  that  they  account  for  the  major  share  of  the  nation's  total 
economic  output.  Recognition  is  mounting  that  the  current  economic 
challenge  is  as  fundamental  as  the  chai^ge  from  an  agrarian  to  an 
industrial  economy  after  the  Civil  War  and  that  education  generically 
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nwst  be  linked  inextricably  to  economic  development  and  be  viewed  as  an 
essential  investment  in  the  future.  Data  on  the  educational  process 
gpj_vgys  <?f  improving  student  achievement  should  be  gathered  frcr.  all 
jgliygfgrg.o^  education  services  and  not  iust  from  traditional  schools 
serving  5  to  17  year-olds. 

yhe  Implications  of  Changes  in  the  Nation's  Demography 

Demographic  data  are  of  particular  importance  to  tha  entire 
society.  In  a  world  in  which  more  than  75%  of  the  total  population  is 
of  color,  we  are  going  to  have  redefine  what  the  words  "majority"  and 
"minority"  mean.  Indeed,  more  than  25%  of  our  public  school  population 
already  is  of  minority  origin,  and  the  proportion  of  Blacks,  Hispanics, 
Asian-Americans  and  Native- Americans  continues  to  grow.  By  1990,  25% 
of  the  total  population  will  be  minority.  In  the  1982-83  school  year, 
for  example,  46%  of  the  public  school  enrollment  in  Texas  was  minority, 
43%  was  minority  in  California,  32%  in  Florida  and  Mew  York,  ?.i%  in 
Arizona  and  Maryland,  28%  in  New  Jersey,  and  57%  in  New  Mexico. 

The  Hispanic  population  is  the  fastest  growing  segment  of  the 
minority  population  with  approximately  two-thirds  of  the  nation's 
Hispanics  being  located  in  only  three  states  (California,  Texas,  and 
New  York) .  More  than  85%  of  the  Hispanic  population  lives  in  only  nine 
states  (New  Jersey,  Florida,  Colorado,  Illinois,  New  Mexico,  and 
Arizona  in  addition  to  the  af or mentioned  three  states) .  This  dramatic 
skewing  of  the  distribution  of  the  Hispanic  population  creates  a 
serious  problem  of  demographic  illiteracy  as  most  of  the  country 
remains  blissfully  ignorant  of  the  full  iapott  of  the  dramatic  growth 
in  the  number  of  Hispanics.  Indeed,  Hispanics  are  the  youngest  popu- 
lation group  so  additional  increases  in  the  Hispanic  population  are 
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quite  predictable. 

California,  our  largest  state,  by  2000  will  be  "inajority-ininor- 
ity.*  Twenty-three  of  twenty-five  of  our  largest  school  systeir.s 
already  are  -majority-minority"  and  unless  we  i-T-^ove  the  quality  of 
the  education  and  the  life  chances  of  these  massive  cohorts  of  minority 
youngsters,  the  social  fabric  of  our  society  may  well  be  inperiled. 

The  demographic  phenomenon  of  "gray  power"  also  will  be  of 
increasing  significance  as  the  population  ages  and  the  number  of 
citizens  65  years  of  age  and  older  rapidly  expands.    By  1990,  the 
number  of  youngsters  under  20  will  fall  below  30%  of  the  nation's 
population  for  the  first  time  in  history.    In  fact,  in  1983,  there  were 
more  people  65  years  of  age  or  older  than  teenagers.    The  implications 
of  these  changes  are  brought  forth  starkly  by  an  analysis  of  the  ratio 
of  working  to  retired  people.    In  1940,  10  citizens  worked  for  every 
retired  person,  in  1985  the  ratio  is  5.3  to  1  and  a  4.7  to  1  ratio  is 
projected  for  2000.    By  2030,  a  2.7  to  1  ratio  of  workers  to  retired 
persons  is  considered  possible. 

Thus,  growing  numbers  o£  retired  individuals  will  be  dependent 
upon  a  younger  population.  Increasingly  minority  in  composition,  to 
sustain  the  economy  in  general  and  to  maintain  the  viability  of  an 
already  rather  vulnerable  social  security  system. 

It  is  estimated  that  more  than  90%  of  the  1990  workforce  and  more 
than  80%  of  the  2000  workforce  already  are  employed  in  the  market 
place.  Thus,  traditional  schools  serving  the  young  will  be  dealing 
with  only  a  small  proportion  of  the  workforce,  a  full  one-half  of  this 
younger  population  will  be  minority  youth  who  will  constitute,  as  noted 
earlier,  a  much  higher  percentage  of  the  next  decade's  diminished  youth 
cohort.    It  is  projected  that  by  2000,  approximately  one-third  of  the 
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ycur.g  will  be  socially  and/or  economically  disadvantaged. 

Such_demQgraphic  data  are  of  singular  importance  and  should  be 
widely  disseminated  not  only  to  educators  but  also  to  citizens  through-: 
eat.tlie.sQcigty,  These  rather  startling  numbers  reflect  compellingly 
why  traditional  schools  will  have  to  broaden  their  base  of  political 
support  with  less  than  30%  of  the  population  currrently  having  young- 
sters enrolled.  Educational  leaders  ceui  no  longer  assume  the  public 
support  they  could  generate^  for  example,  when  60  or  70%  of  the  popula- 
tion had  children  in  the  schools  in  the  rqpid  growth  era  after  World 
War  II.  Schools  will  have  to  reach  out  to  cultivate  new  and  broader 
constituencies  if  they  are  to  acquire  the  necessary  support  as  older 
citizens  and  other  groups  make  increased  demands  for  services  in  a 
period  of  declining  resources.  Public  schools  will  have  to  be  viewed 
as  a  civic  responsibility  by  the  majority  of  the  population  which  will 
not  have  children  involved  or  a  direct  stake  in  the  educational 
process.  Educators  can  no  longer  assume  that  they  have  a  broadly 
gauged  support  base  and  certainly  cannot  afford  the  luxury  of  pulling 
the  wagons  around  in  a  circle  and  shooting  inwardly  as  has  often  been 
the  case  in  the  intramural  or  internecine  warfare  which  has  occurred 
with  some  frequency  over  collective  bargaining,  church-state  relation- 
ships, funding  allocations,  desegregation,  interlevel  responsibilities, 
and  other  issues. 

The  Importance  of  Reconfiguring  and  R#d#finin9  Education 

\s  part  of  the  efforts  to  broaden  their  support^base,  educational 
leaders  will  have  to  reconfigure  and  essentially  redefine  education  as 
constituting  more  than  just  traditional  schools  or  formal  institutions 
of  learning.    The  expanded  coalition  which  they  will  be  compelled  to 
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,    Knrtren   senior  citizens,  the  numerous 

^■>A^r  workers  who  will  nave  zo      >-  .      .  ^ 

^^^^     opfottunities  xn  a 

who  -ill  r.qul«  .duc.txon.1  and/ 

M„iti-MencY  and  eoUaborstive  human  service 

.nd  private  sectors  wll  ,„3,i,„«on.l  penetration  Into  the 

caucators  have  uni,ue  .ocxal  ana  x    txto^^^.     J  ^  ^  ^^^^^ 

c  ..<r«.Mailv  every  community.    This  outteaui 

.„a  expand  their  o.n  .uppor  has. 

th.  ascalatin,  .duc.tion.1  neads  of  adult  ,  P  ^^^^^^ 
citi«ns,  Older  wor.ar.  .ho  need  r.traxnxn,,  -.d  "^^ 

.     ith  -latchkey  children.  fts.t!lsaS-Sall4bSI»ti2t-*«=" 


 a  ,r«t.r  d.,r..  th«>  it  ha.  thus 

rh,r  aociety  must  recogniie  to  a  gi««'- 

tlonal  .arvice  .  site  called 

proprletar,  .chool.  «.d  coll.,*.  - 

..miv.r«itv%  the  far-flung  and  extensive  « 
•  coll.,.-  or   «ni«r.i«  ,  ^  ^^^^^^^ 

tlonal  .y»t«»>.  hospltax.  which  prov 

-ncl..  «lth  aducatlonal  pr09ra»»  auch  a.  th.  * 
..jor  ..rvic.  .,.nci..  -i  b  ^^^^^  ^  ^ 

scout,  and  Onitad  tray.  " 

t,r  .xa.pl.,  inv..t.  appro.i«t.ly  MO  billion  in 
X.du.try.  tor  .Ka.p  ^^^^^^^^  ^ 

education  and  tralnin,.  •  total 

traditional  P-hUc  hi,her  education.   Control  Data  .«.nd. 
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rilliouc  of  dollars  in  its  Plato  syste.-n  and  innunerable  other  corpora- 
tions such  as  IBM,  Xerox,  and  General  Motors  are  allocating  substantial 
resources  to  inprove  the  quality  of  education  and  training  received  by 
their  employees.    Wang,  Rand,  Northrop        A.D.  Little  actually  offer 
degrees  under  the  aegis  of  their  corporate  educational  activities  and 
Hamburger  and  Holiday  Inn  Universities  are  realities.  Such 
non-traditional  post-secondary  educational  enterprises  already  are 
educating  well  over  one-half  of  the  adults  in  the  nation.    This  is 
hardly  an  inconsequential  shadow  system  and  traditional  educators  and 
other  providers  of  hus»an  resource  development  services  must  be  more 
cognizant  of  the  collat>orat<ve  opportunities  as  well  as  the  po-.ential 
competitiveness  of  this  s.^ewhat  parallel  and  non- traditional  systan. 

MgE§-lDfginiatlQD  must  be  avstematirany  rn^Ht^  fl^?Lt  this  import^pt 
^  and  rapidly  expanding  nrivm^^  sector  oased  educational  svstem. 

Thg  Impact  of  Technology  on  Eduea»ir;,fli        pconomie  npvAinpmApt 

The  area  of  technology  confronts  the  entire  society  with  a  host  of 
challenges  and  opportunities.  The  unprecedented  technological  revolu- 
tion which  confronts  us  will  reshape  virtually  every  facet  of  our  lives 
in  varied  and  unpredictable  ways.  The  world  of  computers,  discs, 
satellites  and  so  forth  is  upon  us  and  our  young  people  from  all 
socio-economic  backgrounds  will  be  activated  in  new  ways  to  partake  in 
the  technological  era  which  has  dawned. 

Fields  like  science  and  aath,  of  course,  are  essential  for  techno- 
logical progress  and  our  society's  need  foi  well  educated  citizens  in 
these  areas  increasingly  is  being  recognized.  The  crisis  in  math  and 
science  education  alrsedy  is  generating  significant  changes  in  educa- 
tional policy  which  wcjlJ  not  have  been  politically  viable  just  a  short 

ERIC 


time  ago.  Notions  like  merit  pay,  differential  salaries  and  rotes  for 
teachers,  and  the  recruitment  of  part-time  teachers  from  the  private 
sector  or  the  ranks  of  the  retired  would  not  have  received  serious 
attention  in  either  state  legislatures  or  the  U.S.  Congress  without  ^he 
widespread  national  consen.^us  that  our  econcnic  development  is  inextri- 
cably linked  to  the  quality  of  our  educational  system  and  that  our 
nation's  scientific  literacy  cannot  be  permitted  to  lag  any  longer  if 
we  are  to  compete  in  an  increasingly  interdependent  world  economy. 

IliL-flJillLD£i-nf-th1n  innnr  fff^r*^-^  "«  rnr^fuUv  qathfr  Infonwtign 
Qbrut_tbf_n^if^:ffffffF  faiinrps  of  thf>  varied  effo^tS-wbiglLJifiJ^&ina 
initi-tfil  ttir^vi^'""*-  ^^'^  mr^^     attmct  more  cwn1ifif<1  scipnge  an«? 

ing«-h  teachers. 

The  reality  is  that  the  tempo  of  economic  and  technological  change 
is  such  that  partnerships  between  the  public  and  private  sectors  are 
essential.  There  simply  Ip  no  way  in  which  schools  or  rost  other 
public  entities  can  maintain  .tate-of-the-art  aquipinent  or  kc.>p  up  with 
the  new  technologies.  Creative  tax  and  related  policies  must  be 
developed  which  facilitate  intersector  collaboration  if  we  are  to  meet 
the  international  economic  challenges  ^'rom  nations  like  Japan  and  West 

Germany.  InffiiniflUfin.aUflht^flJ»ft-MllMt«dJ««J-dia«»i*^*^^^ 
yl,,..  worw,  «nd  wh.f  dofftn't  wcK  in  fofitfrlng  coopgration 

Ti»«i  Ramificat<'^»«     ^  Changing  workfocce 

The  changes  which  art  shifting  tha  foundations  of  our  economy 
obviously  have  deep  ramifications  for  educators.  Dramatic  and 
continuing  reductions  in  tha  manufacturing  or  industrial  areas  will 
require  tha  development  of  a  workforce  better  able  to  perform  in  the 
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information  and  service  providing  realms.  We  will  thrive  if  we  sell 
our  wits  -  if  not  our  goods  •  to  the  world  and  our  major  future 
resource  is  brainpower. 

The  challenge  educationally  is  not  only  to  inprove  basic  skills 
but  also  to  react  to  the  changes  in  occupational  context  which  will 
compel  more  workers  to  shift  from  '^take/place/lift/put"  jobs  to  work 
like  computer  programn^ing  which  requires  listening  and  reasoning  skills 
as  well  as  adequate  backgrounds  in  fields  like  math  and  science.  These 
chedlenges  cannot  be  met  hy  single  sector  ^proaches.  As  a  society,  we 
can  no  longer  afford  the  luxury  of  fragmentation  or  "turf smanship*. 
The  challenges  will  require  Institutional  collaboration  between  and 
among  education,  business,  labor  and  government.  Education  and 
training  must  be  viewed  more  generlcally  and  as  a  multi-sector  and 
societal  responsibility  in  which  we  all  have  a  stake  and  role.  The 
Digital  Corporation,  for  example,  allocates  from  10  to  201  o£  the  time 
of  its  engineers  and  other  highly  skilled  personnel  for  in-service 
training  so  that  they  can  keep  abreast  of  the  phenomenal  rate  of 
technological  change  which  gives  the  schooling  of  a  newly-graduated 
engineer  only  a  five  year  period  of  relevancy.  Organized  labor  also  is 
acutely  aware  of  the  continuing  need  of  reeducating  and  retraining  its 
members.  Indeed,  recent  contracts  in  the  auto  Industry,  for  example, 
explicitly  provide  time  for  training  or  educational  activities. 

Kb  a  society,  ve  can  no  longer  afford  parallel  and  costly  human 
resource  development  systems  which  rarely  if  ever  interact  and 
collaborate.  We  are  no  longer  rich  or  wealthy  enough  to  afford  such 
costly  duplication  and  fragmentation.  Business,  for  example,  is 
compelled  to  spend  many  millions  of  dollars  on  remedial  education,  a 
responsiblity  which  quite  logically  could  have  been  assumed  to  have 
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been  within  the  purview  of  the  schools.    AT&T,  for  example,  which 
spends  almost  $2  billion  annually  for  educationally  related  activities, 
expends  considerable  money  teaching  thousands  of  e:r,ployees  basic 
writing  and  arithmetic  skills.    Metropolitan  Life,  like  numerous  other 
corporations,  devotes  a  large  porportion  of  its  training  program  to 
remedial  work  in  the  basics.    Effnftff  ntlMl^  i?f  m^i^  to  rollggt  infPl- 
^aUaD-^bgut-gusb-"n>fidim  effort,  to       if  ,,v^,inj9i^si^ss^^^ 
effective  in  pyipHc  institatians. 

Despite  these  problems,  the  United  States  has  great  advantages 
once  we  'get  our  act  together-  and  generate  the  necessary  intersector 
linkages.    We  have  a  strong  base  and  tradition  as  a  creative  entre- 
preneurial society  and  our  education  systm  despite  its  weaknesses  has 
produced  a  uniquely  well  educated  and  adaptable  population.  Parenthet- 
ically, it  is  iH«x,rtant  to  point  out  that  efforts  by  educators  to  build 
partnerships  with  the  private  sector  should  not  be  limited  only  to 
large  corporations.    Approximtely  580,000  small  businesses  are  started 
each  year  in  this  country  and  two-thirds  of  the  new  jobs  are  created  in 
smaller  enterprises.   Thus,  the  op^rtunities  for  partnerships  between 
education  and  business  in  many  cases       be  more  effectively  developed 
at  the  local  or  regional  level  where  much  of  the  action  if  not  the 

rhetoric  takes  place. 

A  dominant  »-nd  recurrent  theme  articulated  in  aJl  of  the  recent 
reports  on  education  relate,  to  the  concern  about  the  quality  of  the 
teaching  force.  There  is  widespread  consensus  th^t  «ty  efforts  to 
strengthen  education  and  the  development  of  our  human  capital  must  be 
predicated  upon  improving  the  status  and  intellectual  caiber  of  the 
classroom  teachers  who  are  at  the  core  of  the  ^Sucational  enterprise, 
in  recent  years  with  the  constraints  on  governmental  spending  there  has 
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h-en  a  drain  of  talent  from  the  public  sector  and  service  fields  m 
general.  Teaching  without  question  is  not  attracting  our  "best  and 
brightest"  young  people  and  more  vigorous  attempts  must  be  mace  to 
replenish  and  strengthen  the  ranks  of  those  responsible  for  developing 
the  future  intellectual  capital  which  is  so  vital  to  our  security  and 
well-being. 

The  problem  is  most  acute,  of  course,  in  areas  like  math  and 
science  where  the  economic  and  status  rewards  of  teaching  cannot  begin 
to  compare  with  the  salaries  and  recognition  available  to  talented 
individuals  in  business  and  industry.  We  have  finally  recognized  that 
we  have  a  crisis  of  national  proportions  with  approximately  only 
one-half  of  our  math  and  science  teachers  appropriately  certified. 
Throughout  the  country  numerous  proposals  are  being  made  to  differen- 
tiate roles  and  salaries^  develop  merit  pay  scheduleSf  and  recruit 
part-time  instructors  from  the  private  sector  as  efforts  intensify  to 
attract  and  retain  talented  teachers.  A  number  of  school  districts 
have  already  implemented  such  plans  and  recently  large  states  like 
Florida  and  California  among  others  have  enacted  cos^rdienslve  reform 
legislation  which  has  included  provisions  for  merit  compensation  or 
differential  categories  of  teachers  who  would  receive  extra  pay.  Qa^ 
flD-tbfiae^Itflita,ihflUld-hg^flIIfigtgd-jmd-gfliefful  evaluation  made  Qt 

what  works  and  what  doesn't  work  on  a  coBt-bgnefit  basis. 

The  quality  issue,  of  course,  has  been  exacerbated  by  the  fact 
that  women,  who  still  constitute  approximately  two-thirds  of  the 
nation's  classroom  teachers,  now  have  expanded  career  options. 
Talented  and  intellectually  able  women  who  in  the  past  entered  teaching 
because  it  was  the  traditional  and  logical  thing  for  them  to  do  are  now 
entering  other  professional  fields.    Within  the  past  decade  or  so,  a 
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•perverse  form  ol  Indenturea  servitude-  has  been  clearly  -eakened  a. 
„a„y  of  our  .o«  talented  women  quite  appropriately  select  a  much 
broader  range  of  career  options.    For  example,  in  1965  only  6.5%  of 
medical  school  graduates  were  female,  in  1960  the  percentage  soared  to 
23. 4»,  comparable  figures  for  law  school  graduates  were  3.2%  in  1965 
and  30.2%  in  1980  respectively.    In  1950,  only  an  infinitesimal  .3%  of 
the  engineering  graduates  were  women,  by  1980,  8.8%  were  female.    It  is 
reasonable  to  assume  that  many  of  these  women  doctors,  lawyers  «>d 
engineer,  in  prior  year,  would  h».  b.«.  school  te«:h.r..   Their  loss 
to  education,  of  course,  and  the  continuing  expansion  of  career 
opportunities  for  able  women  further  compound  the  problem  of  attracting 
into  teaching  adequate  number,  of  our  -ost  intellectually  able  young 

people.  Bt^b8uia-aiMlM-a«t«ilri-lafMMtt'>"  '^n  mil  IF-qnltit^t 
Bl.M8MaaD-»blth.ha».iu  l«1  rnmlflrntion.  for  tnf  w.litY 

^  m  

NO  litany  of  major  human  resource  or  educational  issues  can  or 
.hould  ignore  ««  mention  of  the  «:»t.  problem,  of  urban  and  minority 
youth.    The  Mll«vcy  of  the  d««,«aphle  change.  «.d  concomitant  growth 
in  .inority  population  were  dl.cu...d  at  the  out..t  of  thU  paper, 
special  attention,  however,  «i.t  be  foc»«d  upon  the  rtockln,  raality 
that  almoat  .n.-haf  of  bl.cK  teenagar.  have  no  Job.  ^  that  youth 
.     unemployment  i.  higher  than  20%.  «r.  than  twice  the  overall  unemploy- 
ment figure  for  the  country.  Dropout  rate,  are  a.  high  a.  40%  in  .«.y 
of  our  urban  .ehool  dlstric...    These  number,  project  starkly  the 
danger  of  our  urban  «:hool.  becoming,  in  on.  colle,.  pr-ldenf.  words. 
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"warehouses  for  the  angry  or  staging  areas  for  anarchy".  W$  Pggj  %° 
flpa^ygeji^ese  issues  even  more  carefully  ^^nri  collert  information  whjch 
tflll-DIQyijg- th?  b^^jg  fgF  in>p;gmentinQ  badlv  needed  remedies  in  <^iil 
problem  Plaoued  urban  districts. 

In  addition  to  the  traditional  morally  compelling  argum.ents  for 
equity  or  the  equalization  of  educational  opportunityr  there  are  now 
selfish,  vested-interest  reasons  for  wanting  to  improve  big  city 
schools  whose  student  population  will  be  90%  minority  by  1990.  As  tne 
demographic  data  reflect,  our  population  is  aging  and  shrinking  cohorts 
of  young  people  must  be  productive  to  generate  the  revenues  necessary 
to  support  services  in  a  changing  economy.  More  of  these  youngsters 
obviously  will  be  of  minority  origin  and  they  represent  veduable  human 
resources  which  our  nation  and  economy  cannot  afford  to  fritter  away. 
Indeed,  there  will  be  a  201  reduction  in  the  entering  workforce  in  the 
^  16  to  24  year  old  age  bracket  through  1990.    These  numbers  indicate 

that  we  need  to  develop  the  capabilities  of  all  of  our  youth  to  their 
fullest  potential.  We  must  substantially  inprove  our  35  to  45%  high 
school  dropout  rate  and  as  one  cynical  realist  says  (hopefully  with 
tongue  in  cheek)*  "let  us  forget  justice  and  think  profits  and  economic 
s  u  rv  ival " .  I2A^A.fiaaSfiUfi&Ulkfi.ft£bfifil.dlfiBfiUta.ADd.£bfi.fibliOliiD3 

yc^th_l!Ch^^rt-BhPuld_bf_qat^f ^"'^  disseminated  more  extensively  so 
tbflt^bfiifi-ia.agifi-Bttblig-gfinagifiufiDfiaa^f-ttig  ggllcctive  gt»ke  the 

entire  soeiety  has  in  ameHorafiinn  th»  urban  crisis. 

Thg  Need  to  Define  and  Aehlev*  Quality  at  All  Educational  Levels 

Several  other  issues  warrant  at  least  brief  mention.  There  is 
growing  concern  for  quality  in  every  facet  of  American  life  from  cars 
to  schools.   The  recent  reports  on  education  have  decried,  for  example, 
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•the  tising  tide  o£  mtdiocrity-  ot  th«  "la<: . 
schools.  While  .c.nowl.a,in9  th.  undeniable  ,..d  to  bolster  the 
a»oe.i.  quality  of  »any  of  our  pro,r=^.  we  =an„ot  afford  to  retreat 
f  ron,  our  national  concern  with  the  isau.  -~f  equity  or  access  which  nas 

.     •     •  n*.!t  few  decades.    Quality  does  not 

received  such  emphasis  in  the  past  tew  aecau 

..-.re.     These  two  transcendent  goals  are 
preclude  equity  or  vice  versa.    These  tw 

«.  -./.h  other     The  consequences  to  our  society 
completnentary  and  support  each  other. 

*t  the  Pxoense  of  the  other  are  grave  because  of  the 
of  emphasizing  one  at  the  expense  ot 

economic  and  ^.>^ic  i.^r.tiv..  diacuss.'  ..rlt.r  which  hi,hli,ht 
the  dranatic  increases  In  youn,  .Inority  group  .embers  and  the 
continuing  eo».it«nt  of  equalizing  educaUonal  opt»rtunity  which  -at 
be  at  the  core  of  our  democratic  .yst«..  At  th.  .a».  ti«,  however, 
the  quality  of  »any  of  our  institutions  has  beco.e  shoddy  and  a 
parallel  co»»lt«nt  t.  quality  i.  esaential  if  w.  are  to  compete 
.cono.ic.Uy  and  educationally,    pnt.  On  ^Oth  the  ««m-»na^ 

.oli»ht»»a-B»m»^Ui  III,  nn  fnmmfi  »  ^l^^sb^^^ 
nmry*""  ttirnf  -"■■i  <nt>rrffintwl  welt- 

another  !..».  warranting  .o«  ~«tlon  I.  the  appalling  decline  in 
language  training  In  th.  United  Stat.,  in  a  .bringing  world  with  an 
int.rd.p.nd.nt  global  «on-».   *  e...  c«.  be  «de  that  our 

co^titiv.  position  .conc.ic.lly  U  we-cened  b«.u..  of  the  deterior^ 
tion  in  both  th.  quaity  ^  qu«.tity  ot  our  foroign  l«.g»ag.  i»«ruc- 
tiun.    H«.y  aapan...  «.d  Europaana,  for  ..a.ple.  ^«       •P-'^  - 
language.    The  nu«b.r.  of  our  citi»n.  abl.  to  conv.r..  in  o the 
tongue,  i.  aby.»ally  li-ited.    Our  bu.in...e.  thu.  have  a  distxnct 
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ais,dv»t.9e  in  areas  Vi.e  ^rR.tin,  and  sales  vis-a-vis  their  foreign 
co-petitors.    The  statistics  tell  the  story  »ore  graphically  than 
words,    only  15»  of  our  high  school  students  currently  study  foreign 
languages,  the  figure  .as  24%  in  1«5.    Only  5.  of  high  school  students 
study  foreign  languages  beyond  the  second  year  and  just  8%  of  our 
institutions  of  higher  education  require  students  to  have  studied  a 
foreign  language,  in  1966,  34»  of  the  institutions  required  such 
infraction  for  admission.   These  shocking  numbers  should  encou.age  us 
to  welcome  »any  new  citizens  who  have  th.  advantage  of  speaking 
languages  other  th«.  English.    These  new  residents  who  can  speak 
Spanish  «nd  other  languages  c«>  prove  to  be  a  valuable  economic 
resource  as  we  seek  to  inprove  our  international  economic  position, 
lis  ranrlr—  ^M,..tinn  .nd  fll^.e^infltiCT  of       fhirh  rfflwt  this 

H1 1111  Im-Mn  Br—  i.i.~r^.n.'.ronflnrY  nnfl  Ulnhfr  Mi.«tign 

Another  Issue  requiring  th.  att«,tlon  of  «lu«Uon.l  leader,  ana 
a.t.  collector.  I.  the  n..a  to  .or.  clo.ely  coordinate 
elementary-.econd.ry  «.d  higher  eduction.    Th.  twelfth  ,r.de,  of 
cour.e,  i.  the  «,lc.l  «d  s^rtid  dividing  lin.  bet....  the  two  «.d 
effort,  must  be  exp«,aed  to  mote  effectively  bridge  the  l«els  In  .re« 
where  they  overly.-  *P""«« 
they  «y  exist,    for  ..»Pl..  "^"^ 
„d  vocational  progr».  that  .re  quit,  .imll.r  to  th.  offerings  of 
school  .y.t«.  und.r  th.  ..gl.  of  -»lt  b«lc  eduction.  Mechanism, 
.hould  be  created  .t  the  local  or  regional  level  that  wUl  coordirat. 
pro,r«..  .or.  effectively.   M.o,  «  ought  to  move  ».y  fro.  categor- 
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.c^  sec-a^iocs  ana  blatar.t  political  tra.e-cffs  that  ta..EC.a.Uy  -t.,- 
p.ac.  between  the  level..    I.  .ducators  do  not  taXe  the  initiative  in 
„tionali.in,  their  s,ste.s,  politicians  ce.tainl.  will  at  a  ti=« 
.ecunin,  resource.,  lal^.^.^^r.-^^^^^-^^^^^^^^^^^^^''^^^ 

There  are  -ajor  pragmatic  reasons  for  increased  com»uni=atxon 
between  higher  and  elementary-secondary  education.   ^  the  competition 
,or  dollar,  beco...  ...n.r.  th.r.  I.  .  r.U  d.n,.r  of  dy.function.1 

interlevel  conflict  both  for  governmental  and  private  funds.  In 
California,  for  e.«.ple,  the  recent  co.pr*ensive  reform  legislaUon 
include,  an  «00  Dillon  ta.  increase  to  be  used  for  the  schools, 
higher  education  «>d  other  ..rvlce.  were  cut.  Even  in  the  area  of 
private  ,lvin,  .her.  higher  higher  education  ha.  had  the  terrain  to 

that  could  generate  negative 
Itaelf,  there  h«re  been  development,  th.t  couia  , 

competition  beUe-.  the  Ir,.!..   the  public  .chool.  h»e  Ju-t  recently 
turned  to  the  private  MCtor  for  .upport  «.d  local  »d  regional  fo»  ^ 
tlon.  are  being  created  throughout  the  country  to  «rv.  a.  the  consult 
,,r  contribution..    *  new  Public  Education  rund  ha.  the  «p  Icxt 
purp,..  Of  .ervlng  »  •  cataly.t  In  the  development  of  loca^  «.d 
regional  foundation,  -hlch  »U1  »«.  a.  «char.l.m.  to  funnel  private 
...ource.  into  th.  .chool..   BtU^llMllimr.  „1.r.      m  V.ri.U» 

^  no  overt  Interlevel  conf Uct 

thu.  far.  the  danger,  of  thl.  occ..^  «•  -  -""'^7 
.re  th.  f lr.t  to  .ay  th.t  Intern.clne  conflict  within  a  policy  realm 
U..  education  could  hurt  .v.ryon.,  particularly  .t  a  tlm.  wh^n 
„.ource.  will  be  harder  to  find  and  competition  I.  K.«.er.  Educa 
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tional  leaders  from  all  segments  of  the  enterprise  have  a  responsi- 
bility to  try  to  ensure  that  such  interlevel  conflict  does  not 
transpire. 

The  Appro^  r^ate  Federal  Role  in  the  Shaping  of  Educat.1on?l  PqUCY 

The  appropriate  role  of  the  federal  government  in  the  shaping  of 
educational  policy  remains  a  persistent  and  controversial  issue. 
International  political  and  economic  issues  and  concerns  would  appear 
to  require  national  responses  if  not  huge  federal  programs.  It  seems 
unlikely  that  50  state  school  systems,  some  16,000  local  school 
systems,  and  more  than  3,200  post  secondary  educational  institutions 
have  either  the  human  or  econanic  resources  for  the  expensive  research 
and  development  investments  that  have  to  be  made  in  the  new  technol- 
ogies, science,  math,  foreign  language  and  computer  education.  The 
necessary  technological  crash  programs  and  heavy  up-front  investments 

* 

needed  in  new  areas  like  computer  education  miist  be  promulgated  at  the 
federal  level  as  we  compete  in  an  international  economy  against 
countries  like  Japan  and  West  Germany  which  have  national  planning. 
EffOrtff  T*'""^'^  h#  maH*       eongist^ntlv  assesw  the  CaPaMlitiCS  Of  MCb 

lfi£fil-fi£-aa3ttiDiDfiDt-tg~Bia3tidfi,nfiv  rfchnolgqies  in  ttift  instructignal 

Although  there  were  without  doubt  excesses  in  some  of  the  educa- 
tional initiatives  undertaken  by  the  federal  government  in  recent 
years,  we  cannot  afford  to  throw  the  baby  out  with  the  bathwater.  In 
other  words,  we  need  to  find  some  middle  ground  between  federal  domina- 
tion and  a  pKogranmatic  void  in  technical  areas  which  the  country 
cannot  afford.  Indeed,  our  concerns  with  areas  like  math,  science  and 
technology  ought  to  serve  as  lightning  rods  as  all  segments  of  the 
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society  acknowledge  a  common  stake  in  national  priority  setting  and  a 
balanced  federalism  if  we  are  to  maximize  the  development  of  our  human 
capital « 

The  ll!§J2I«issufir  in  essencer  is  how  we  reconfigure*  a  fragmented 
and  uncoordinated  educational  and  training  systeai  to  meet  emerging 
economic  and  workforce  need^  without  stifling  the  strength  of  its 
diversity.  A  key  component  in  this  reconfiguration,  as  I  have 
stressed,  is  widespread  acceptance  of  a  luore  generic  and  broader 
definition  of  education  at  representing  more  than  just  traditional 
schools  and  colleges  which  serve  the  young.  Such  a  reconfiguration 
will  have  to  be  based  on  much  more  mutual  understanding  and  exchange  of 
information  between  and  among  the  varied  educational  delivery  systems. 
Ibia^undfiistflDdiDg^flDd^tbfiaciDffiimfltlaD^fitghanqes  yill  require  ngw 

education  serving  providers > 
In  ConclusiQit 

In  this  papers  I  have  attempted  to  provide  an  environmental  scan 
of  a  number  of  salient  social,  political  and  economic  issues  which 
impinge  upon  educational  policymaking.  Indeed,  my  overarching  thesis 
is  that  schools  are  the  dependent  variables  of  larger  social  and 
economic  forces  which  drive  public  and  educational  policy.  NCES  ought 
to  broaden  and  diversify  its  approach  to  the  collection  and  dissemina- 
tion of  information  so  that  daU  relating  to  these  larger  environmental 
factors  which  so  inordinately  influence  schools  are  woven  iito  and 
amplify  straight  statistics  pertaining  more  narrowly  to  school  systcns 
and  educational  institutions^. 

More  accurate  and  broadly  gauged  data  will  be  essential  if  elemen- 
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tary  and  secondary  education  is  to  maintain  political  and  econor:c 
support  at  a  time  when  less  than  30%  of  the  adult  population  has 
children  enrolled  in  school.  The  recent  reform  movement  offers  unique 
OF?ortuniti*>s  because  of  the  interest  manifested  in  improving  education 
by  Governors,  business  and  civic  leaders  and  other  political  influen- 
tials.  Economic  support  will  be  forthcoming,  however,  only  if  tax- 
payers are  convinced  rather  quickly  that  there  are  tangible  results  of 
their  increased  investment  as  measured  by  inproved  student  performance. 

In  fact,  the  reform  movement  may  already  have  crested  and  there  is 
an  urgent  need  within  the  immediate  future  to  sort  out  the  various 
reforms  and  determine  which  have  been  most  effective  on  a  cost-benefit 
basis.  Michael  Kirst  of  Stanford  University  identifies  the  following 
four  phases  in  the  issue  attention  cycle:  (1)  alarmed  discovery;  (2) 
crisis  activity;  (3)  disillusionment  with  results;  and  (4)  return  to 
neglect.  A  compelling  case  can  be  made  that  the  education  reform 
movement  currently  ii  rapidly  passing  through  phase  2  and  that  its 
ability  to  endure  will  be  predicated  upon  its  effectiveness  as  measured 
in  phase  3  which  is  iii{«nding. 

Thus,  NCES'  current  effort  to  redesign  its  elementary  and 
secondary  education  data  program  comes  at  a  particularly  propitious 
time.  Its  data  collection  strategies  should  be  tied  in  whenever 
possible  to  the  reform  movement  which  is  sweeping  the  nation. 
Systematic  data  should  be  compiled  which  will  determine  which  programs 
are  successful  and  which  are  unsuccessful  because  the  resources  will 
not  be  available  to  support  the  entire  panoply  of  reforms  that  have 
been  offered.  It  is  important  to  document  as  expeditiously  as  possible 
some  of  the  results  which  appear  to  be  salutary.  Kirst,  for  example, 
points  out  that  in  California  t^ere  are  indications  that  there  already 
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Has  b«n  .  :o»  increase  in  hi,.  ..n-.l  science  »a  ..th  en.oii>.nts 
Since  «>e  c.pre.ensiv.  reform  legislation  wes  recently  enacted. 

ocants  a  very  brief  non- inclusive  summary  of  a 
The  following  represents  a  very  ot^ci. 

number  of  the  major  suggestions  made  in  this  paper: 

1.  A  troader  definition  of  ea^^^^^^^^^^  J.-^p^AtaU 
include  other  deV;*""^^^,^"^^^^^^^  and  many 

-  ?ffio«or  a-s^d  ?i«iiSeroredrJ^^^^^^ 

services  should  be  encouraged. 
,.  rat.  .ho.ia  b.  ,.th.r-  fro.  mj^^ 

Urin5TxJr»V.".f^"to^i.1i»  .hould  b.  «d.  between 

the  diverse  sectors. 

w  ronsifit  of  more  than  just  straight 

4..  Data  should  c^JfA!!-     sources  of  information  should 

school-focused  »<^ati8tic8.    »>urQ^8     promising  pcactices 

include  case  "tudies,  compendia  oi^  ^^^  ^^^^^^ 

reirnW":i.erf  r^cJi".!^  of  the  .ducation  and 

training  world. 

«.  in  .Wition  to  th.  c».t.-.Y^eh^^^^^^ 

SI  «^5J2!'t  o^rt«nitl«i 

hi  fflf.  «  I'Si-rJ  SI  «So»"'^£.-ti«l  .t.£«in9 

„,  ft"?».  of  «,»ity  .nd  ,«iity  "'^^ 
relationship 

rtS      5nS^T«-,».,.  ln.tr«ctlon 
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Since  the  late  1970's  the  National  Center  for  Education  Statistics  (NCES) 
has  produced  some  of  the  most  useful  and  usable  data  about  Hispanics  from  among  a 
wide  variety  of  governmental  agencies.  But  that  ledde  hip  edge  is  beginning  to 
erode  as  other  statistical  agencies  such  as  i:i  the  Department  of  Health  and  Human 
Services  have  come  to  realize  their  data  gaps  and  are  mounting  serious  data  collec- 
tion efforts  about  Hispanics.  The  momentum  ^"^r  these  efforts  were  accelerated 
after  the  1980  Census  documented  the  growing  number  of  Hispanics. 

NCES's  data  efforts  in  regard  to  Hispanics  have  been  in  both  illumirfating 
specific  problems  such  as  language  use  and  background  as  well  as  actively  pursuing 
strategies  to  amplify  the  collection  apd  dissemination  of  Hispanic  data.  Ironically, 
while  we  now  know  more  about  Hispanic  high  school  students  in  general  and  about 
language  use  in  specific,  we  still  have  not  developed  adequate  data  and  models  to 
explain  how  English  language  deficits  or  bilingualism  interact  with  other  factors 
to  affect  attainment  and  achievement.  On  the  other  hand,  because  of  the  NCES 
data,  we  can  now  identify  a  number  of  basic  issues  beyond  the  traditional  concern 
of  language. 

But  NCES  cannot  rest  on  its  laurels  and,  in  fact,  will  need  to  move  aggressively 
to  maintain  its  current  assets  and  to  anticipate  new  demands  for  data  on  Hispanics. 

It  will  be  another  two  decades  before  Hispanics  actually  outnumber  blacks  to 
become  America's  largest  minorit>  but,  of  course,  in  a  number  of  cities  and  in 
some  regions  this  is  already  a  reality.  More  critical  in  regard  to  data  needs  is  f 
that  Hispanics  are  replacing  blacks  as  the  group  at  the  bottom  of  the  education 
ladder  in  terms  of  both  attainment  and  achievement.  We  know  Hispanics  drop  out 
at  greater  numbers  on  the  different  levels  of  education  but  that  Hispanics  achieve 
about  the  same  as  blacks  now  is  not  as  readily  known.  In  comparisons  of  black  and 
Hispanic  achievement,  the  fact  that  larger  numbers  of  poor  achieving  blocks  are 
still  in  school,  and  therefore,  lower  their  average  scores  is  usually  not  considered. 


EDUCATION  LEVELS  AND  TRANSITIONS 

Pre-School  to  Early  Elementary  -  , 

NCES  will  soon  probably  have  to  expand  its  data  collection  to  the  pre- school 
level  (5,4  and  3  year-olds)  in  order  to  account  for  the  effect  on  later  schooling 

Of  the  following  (often,  interrelated)  i^ocietal  factors: 

(1)  Ntore  women  entering  the  work  force  while  their  children  are  young; 

(2)  The  recent  return  of  high  le/els  of  poverty  among  children,  especially  minority; 

(3)  Increase  in  female-headed  households;  and 

(4)  The  push  for  early  childhood  education  as  a  major  policy  response  to  these 
three  factors. 
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What  is  the  Hispanic  situation  for  each  of  these  factors  and  what  are  the 
implications  of  these  factors  for  collecting  data? 

Although  it  is  a  recent  change,  Hispanic  women  (49%)  are  participating  in 
the  labor  force  at  rates  comparable  to  white  women  (49%)  and  black  women  (53%) 
(DeNavas  and  Fernandez,  1984).  ^ 

Since  1979  the  poverty  rate  among  Hispanics  has  been  climbing  steadily.  The 
poverty  rate  for  Hispanics  under  18  in  1983  was  38.2  percent,  compared  to  17.3 
percent  for  Anglos  (Pear,  1984).  Furthermore,  Hispanic  children  who  live  in 
female-headed  families  are  more  likely  to  live  in  poverty  than  either  white  or 
black  children  in  the  same  situation.  The  respective  figures  are  70.5  percent, 
47.6  percent,  and  68.5  percent.  More  black  children,  however,  live  in  female-headed 
households  although  even  that  dubious  distinction  has  almost  been  matched  by  one 
Hispanic  sub-group:  Puerto  Ricans.  . 

In  1982  about  45  percent  of  all  Puerto  Rican  families  were  maintained  by  a 
woman  with  no  husband  present,  compared  to  an  average  for  non-Hispanic  families 
of  15  percent.  Put  another  way,  55  percent  of  all  Puerto  Rican  children  live  in 
single-parent  households  (Bould,  1985).  About  a  third  of  the  Puerto  Rican  families 
had  one  worker  and  other  third  had  no  workers.  Given  this  set  of  circumstances, 
one  can  readily  understand  why  42  percent  of  all  Puerto  Rican  families  live  in 
poverty. 

Overall,  in  1983,  23%  of  Hispanic  families  were  maintained  by  women  (U.S. 
Department  of  Commerce,  1984)  and  the  median  money  income  in  1982  for  such  women 
was  $7,436  to  $7,458  and  $13,496  for  black  and  white  women,  respectively •  (DeNavas 
and  Fernandez). 

Probably,  the  single  best  background  correlate  to  a  child's  education  achieve- 
ment has  been  the  mother's  education.  The  low  education  attainment  of  Hispanic 
women,  especially  those  in  poverty,  complicates  the  pre-school  situation  for 
their  children.  Among  Hispanic  families  headed  by  a  female  under  45  years  of  age 
with  only  children  under  6  years,  64%  had  less  than  a  high  school  education  in 
1984,  or  put  another  way,  28%  had  only  an  elementary  school  education.  The  com- 
parable figures  for  less  than  high  school  education  among  white  and  black  females 
are,  respectively,  26%  and  25%.  (U.S^  Department  of  Commerce,  1985a,  Table  8). 

What  is  it  like  to  be  raised  in  a  poor  family  headed  by  one  adult?  In  the 
past,  poor  children  entered  school  at  a  disadvantage  because  of  less-developed 
verbal  competence  than  a  child  coming  from  a  middle-class  family.  What  further 
deficits  will  the  children  from  one  aduH  homes  have  if  they  have  even  less  exposure 
to  adult  speech  (as  limited  as  it  may  be).  In  the  case  of  Hispanics,  ve  have  a 
further  complication  in  that  Hisjpanic  children  often  come  to  school  speaking 
mainly  Spanish  or  a  combination  of  Spanish  and  English. 

The  larger  policy  question  to  address  is  whether  we  are  going  to  have,  as 
Bud  Hodgkinson  has  said,  more  "damaged  goods"  on  arrival  at  the  doorsteps  of  our 
elementary  schools  that  we  have  had  in  the  recent  past.    Or,  should  we  be  trying 
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other  policy  approaches  to  prevent  or  reduce  this  likelihood.  Policymakers  will 
not  be  able  to  decide  without  adequate  data. 

Because  of  these  grim  statistics  and  the  knowledge  that  pre-school  programs 
have  had  quite  positive  long-term  effects  with  disadvantaged  children,  pre-school 
programs  and  kindergarten  for  these  children  should  be  widely  adopted.  Head 
Start  and  pre-kindergarten  programs  for  children  from  low  income  families  are 
seen  as  a  way  to  get  these  children  ready  for  school  as  well  as  to  identify  and 
correct  a  whole  series  of  handicapping  conditions  early  before  they  are  compounded 
in  elementary  school  and  later  life.  Some  of  the  handicapping  conditions  and  the 
neglect  of  these  conditions  are  directly  related  to  poverty  and  poor  health  care 
for  the  mother  and  child.^ 

Yet,  Hispanics  did  not  participate  as  heavily  as  other  groups  during  the 
late  1960's  and  1970s  in  federal  programs  such  as  Head  Start.  Even  today,  while 
37.6  percent  of  white  and  36.3  of  bUck  3  and  4  year-olds  are  in  preschool  programs, 
only  23.5  percent  of  Hispanic  3  and  4  year-olds  are  in  similar  programs  (U.S. 
Department  of  Commerce,  1984).  We  do  not  know  why  this  is  the  case,  except  that 
Hispanic  families  may  prefer  not  to  entrust  the  care  of  young  children  to  persons 
who  are  not  relatives.  The  "Current  Population  Survey  could  ask  why  a  c^ild  is 
not  enrolled  at  the  appropriate  level  of  schooling.  The  question  would  yield 
useful  information  on  dropouts  at  the  other  age  levels.  We  will  return  to  this 
question  in  the  next  section. 

As  for  NCES  collecting  data  at  the  pre-school  level,  I  am  not  familiar  enough 
with  data  collection  methodologies  at  this  level  to  offer  advice,  except  that  a 
longitudinal  survey,  with  interviews  of  teachers  and  parents,  to  cover  the  transi- 
tions from  pre-kindergarten  to  the  early  elementary  school  years  should  be  con- 
sidered. 


Upper  Elementary  to  Early  High  School 

Excluding  the  elementary  school  years,  Hispanics  are  less  in  school,  including 
the  pre-school  level,  than  either  black  or  white.  The  Hispanic  attrition  rate  is 
higher  than  either  at  every  level  after  elementary  school.  We  know  Hispanics  are 
often  retained  a  grade  In  elementary  school.  We  also  know  that  tracking  becomes 
more  prominent  from  the  upper  elementary  school  years  on. 

One  might  well  ask  at  this  point:  how  does  the  problem  of  language  fit  into 
this  situation?  Isn't  the  problen  of  limited  proficiency  in  English  the  main 
cause  of  low  academic  achievement  and  dropping-out  for  Hispanics?  A  few  comments 
on  this  topic  are  In  order.  Yes,  langauge  does  play  a  part,  but  the  situation  is 
more  complex  than  would  seem  apparent.  By  the  time  Hispanics  reach  the  ninth  or 
tenth  grace,  their  language  difficulties  in  earlier  years  may  have  caused  them  to 
be  retained  a  year  or  two  In  earlier  grades.  Almost  25  percent  of  all  Hispanics 
enter  high  school  overage  (Brown,  Rosen,  Hill  and  Olivas,  1980).  Hence,  they  are 
behind  their  age  contemporaries  in  school  and  ahead  of  their  grade  peers  In  physical 
and  emotional  development.  Combined  with  other  factors  as  poor  grades  and  attraction 
to  work,  being  overage  frequently  results  in  students  dropping  out  of  school. 
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Yet,  because  the  complexity  of  this  situation  is  not  usually  captured  in  surveys 
of  drop-outs,  the  language  factor  does  not  loom  as  large  in  the  survey  results. 
More  data  and  research  is  needed  to  tease  out  the  factors  and  their  interrelations 
in  this  situation. 

As  useful  as  the  High  School  and  Beyond  data  has  been  for  studying  dropping-out 
between  the  sophomore  and  senior  years,  it  can't  provide  us  with  the  data  we  need 
to  study  the  interrelation  mentioned  because  High  School  and  Beyond  does  not 
contain,  of  course,  any  data  on  those  students  who  dropped  out  before  the  spring 
semester  of  the  tenth  grade.  As  mentioned  above,  many  Hispanics  are  behind  their 
age  peers  in  school  and  reach  age  16  before  they  get  to  the  tenth  grade.  According 
to  a  report  prepared  for  NCES  by  Hirano-Nakanishi  (1983),  about  40  percent  of  all 
Hispanic  students  who  leave  school  would  do  so  before  reaching  their  sophomore  year. 

Just  as  High  School  and  Beyond  spans  the  important  transition  from  high 
school  to  post-secondaT7  education  and  the  world  of  work,  we  need  a  longitudinal 
survey  that  spans  from  the  upper  elementary  through  junior  high  school  years  to 
high  school,  i.e.,  4th,  6th,  8th  and  10th  grades. 


Adult  Education 

Forty  percent  of  Hispanic  20  to  24  year-olds  are  not  high  school  graduates 
and  the  comparable  Puerto  Rican  figure  is  46  percent  (U.S.  Department  of  Commerce, 
1985).  We  can  also  assume  that,  some  of  these  young  adults  are  already  married 
and  have  children^  and  for  many  others,  this  will  soon  be  the  case.  It  is  important 
to  know  what  these  individuals  plan  to  do  about  completing  high  school  or  obtaining 
a  6.E.D. 

What  complicates  the  out-of-school/non-graduate  statistic  for  young  Hispanic 
adults  is  that  it  includes  young  Hispanics  who  have  recently  immigrated  into  this 
country  and  are  not  high  school  graduates.  We  are  not  at  all  sure  about  an  estimate 
for  this  group.  In  any  case,  the  larger  the  number  of  young  Hispanic  adults  who 
have  recently  arrived  in  this  county  without  a  high  school  diploma,  the  more  it 
is  an  issue  for  public  policy. 

While  it  would  be  difficult  for  NCES  to  directly  address  these  issues  through 
its  own  data  collection  efforts,  the  October  Current  Population  Survey  is  a  good 
alternative.  As  mentioned  in  the  pre-school  section,  I  think  a  question  or  two 
could  be  included  that  would  ask:  If  you  or  children  in  your  household  are  not 
enrolled  in  school  at  the  appropriate  level,  why  are  you  and/or  they  not?,  and 
do  you/they  plan  to  continue  your  education. 

Even  the  growing  phenomenon  of  individuals  "stopping-out"  (or  temporarily 
stopping  their  education  with  intentions  to  return)  at  the  post-secondary  level, 
and  increasingly  at  the  secondary  level,  can  be  addressed  through  these  questions. 
These  questions  would  yield  valuable  information  for  higher  education  planning. 

Another  alternative  for  collecting  these  data  would  be  the  adult  sample  of  NAEP. 
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SPECIFIC  DATA  NEEDS  OR  MODIFICATIONS 

The  following  comments  on  classificatory  variables  and  levels,  especially 
those  more  pertinent  to  Hispanic  than  other  groups,  are  offered  as  short  advisories 
that  also  contain  suggestions  for  modifications  or  continued  use  of  the  variables 
or  levels. 

Ethnic  Sub-Groups>  While  Hispanics  of  the  various  groups  are  beginning  to  coalesce 
on  some  issues,  the  socioeconomic  and  education  characteristics  of  the  different 
groups  are  as  diverse  as  ever  and  are  beginning  to  diverge  even  more  so  from  each 
oth3r.  The  residual  category  of  Other  Hispanics  is  now  the  second  largest  group 
of  Hispanics  and  has  become  a  hodgepodge  of  the  various,  most  recent  Hispanics  to 
the  country  with  the  oldest  Hi  spamcs  in  the  country,  theHispanos  in  the  southwest. 
I  mentioned  this  only  as  an  alert  as  I  think  the  Census  Bureau  will  need  to  do 
something  about  this  category  before  other  agencies  can  make  any  changes. 

Nativity  and  recency  of  migration.  While  a  large  majority  of  Hispanic  students, 
and  even  their  parents,  are  born  and  raised  in  this  country,  continui^  -  immigration 
still  makes  these  important  variables  to  maintain.  In  fact,  if  political  violence 
continues  in  Central  America,  and  possibly  escalate  in  Mexico  because  of  its 
economic  and  political  dislocations,  then  we  will  see  even  greater  waves  of  adoles- 
cents and  young  adult  immigrants  to  this  country.  Right  now  we  are  experiencing 
a  surge  of  new  Salvadoran  adolescent  male  immigrants  because  the  draft  age  in  l1  ( 
Salvador  has  been  lowered  to  12.  Many  of  these  youngsters  have  not  had  any  schooling 
in  their  country. 

Language.  Since  the  mid-seventies  we  ha -e  developed  wavs  to  identify  language 
minon ty  students  and  have  learned  more  about  .heir  problems  in  school.  We  have 
moved  towards  core  definitions  of  both  language  minority  target  groups  and  the 
services  they  receive. 

While  we  have  a  considerable  amount  of  self-reported  data  from  national  data 
bases  as  the  1980  Census  and  the  High  School  and  Beyond,  etc.,  a  short  assessment 
of  reading  proficiency  in  both  English  and,  possibly,  Spanish,  would  give  us  a 
better  grasp  of  the  salient  features  in  the  self-reported  assessments.  In  general, 
the  combination  of  these  and  other  activities  will  allow  for  cross-walking"  and 
comparative  analyses  with  other  data  bases.  In  this  sense,  the  proposed  assessments 
would  further  enhance  the  federal  investment  that  has  already  been  made  in  this 
area.  The  proposed  assessments  are  the  next  stage  in  a  logical  progression  or 
expansion  of  inquiry  in  to  the  education  of  language  minority  students. 

I  understand  ETS  proposed  to  add  these  assessments  and  an  expansion  of  the 
language  minority  construct  to  the  NAEP  data  base,  but  I  do  not  know  the  outcome 
of  this  proposal.  Such  data  and  analyses  would  move  us  closer  to  understanding 
the  interrelationships  between  language  difficulties,  school  policies  and  practices, 
school  age  delay  and  dropping-out.  Because  of  the  extraordinary  high  drop-out 
rates  among  language-minority  Hi  spanics,  research  in  this  area  is  a  critical  research 
priority. 
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Gender >  While  white  and  black  gender  differences  are  moderating,  Hispanic  gender 
differences  are  still  quite  sharp. 

Age.  Age  has  already  been  mentioned  in  regard  to  its  importance  in  studying 
Hispanics  who  are  over-age  for  their  grade  placements. 

Parent  education.  NCES  used  "Less  than  High  School"  as  its  first  category  on 
parent  education  in  HS&B  and  other  surveys.  This  is  not  adequate  for  Hispanics 
and  their  low  education  attainment.  The  first  category  reported  should  be  "6th 
grade  or  less,"  or  possibly,  "8th  grade  or  less."  For  Hisbanics,  25  to  34  years 
old,  26.4  percent  had  completed  less  than  9th  grade  in  1982  (U.S.  Department  of 
Education,  1984). 

"At-risk"  construct.  NCES  should  consider  developing  a  construct  for  at-risk 
students,  u'^ing  below-average  grades  and  achievement  scores  in  the  first  quartile 
and  perhaps  some  other  conditions. 

The  construct  would  be  helpful  for  addressing  a  variety  of  policy  concerns 
which  will  arise  as  we  enter  the  second  stage  of  the  current  reform  movement. 


NCES  Data  Sets  to  Keep  or  Delete 

Frr^  ny  perspective.  High  School  and  Beyond  is  the  most  important  to  maintain 
because  of  its  indisputable  value  in  assessing  student  performance,  school  effective- 
ness and  student  changes  over  time. 

I  can  see  the  value  of  the  other  NCES  data  bases  but  I  am  not  nearly  as 
familiar  with  them  as  I  am  with  HS&B. 

The  Common  Core  of  Data  is  an  important  collection  as  well  as  concept.  In 
spite  of  the  great  difficulties  Involved,  more  should  be  done  to  obtain  the  use 
of  common  definitions  among  the  States  for  dropping  out  and  other  student  outcomes. 
Likewise,  more  effort  should  be  given  to  collecting  data  by  racial/Hispanic  indica- 
tors even  though  substantial  political  problems  may  be  involved.  This  same  comment 
applies  to  most  NCES  census  and  sample  surveys,  including  the  needed  private  school 
survey.   About  10%  of  the  Hispanic  student  population  is  in  private  schools. 

In  view  of  similar  information  that  could  be  collected  for  items  like  vocational 
education  facilities  and  equipment  or  scientific  equipment  and  materials,  why  is 
information  on  library/media  centers  collected?   Is  this  survey  necessary? 


Other  Comments  and  Recommendations 

Census  Data  by  School  Districts 

To  ny  knowledge,  not  much  use,  at  least  by  most  people  outside  the  government 
is  being  made  of  census  data  organized  by  school  district.  Perhaps  this  is  already 
the  case,  but  if  it  is  iiot,  an  NCES  program  officer  should  be  assigned  the  task 
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of  working  with  the  Census  Bureau  to  make  data  organized  by  school  districts 
better  known  and  accessible  to  policy  analysts  and  researchers  in  education.  The 
program  officer  should  also  be  involved  in  assembling  as  well  as  devising  solutions 
to  technical  problems  in  using  these  data. 

Multiple  Sources  of  Survey  Data  > : 

A  major  strength  of  the  HS&3  study  is  the  confluence  or  tri angulation  of 
data  obtained  through  different  methods  or  sources.  This  approach  should  be 
praised  and  continued  in  future  surveys.  In  this  regard,  an  expanded  parent  or 
home  interview  for  HS&B  would  hcve  been  useful  and  should  definitely  be  pursued 
in  future  surveys. 


Oversampl ing 

The  oversampl  ing  of  some  Hispanic  subgroups  in  HS&B  was  critical  to  making 

this  survey  the  most  useful  national  survey  ever.  Again,  this  approach  should  be 
continued  in  future  surveys. 

Dissemination  of  Data  About  Hispanics 

NCES  has  not  kept  pace  with  its  previous  achievements  in  this  area.  The 
publication  of  the  Condition  of  Hispanic  Education  by  NCES  in  1980  was  widely 
recognized  and  applauded  in  the  Hispanic  community.  In  view  of  the  new  data 
collected  and  the  pressing  needs  for  this  information,  an  updated  edition  of  this 
publication  should  be  on  NCES's  agenda  for  the  coming  year. 

NCES  should  also  consider  preparing  and  releasing  for  the  use  of  analysts 
and  researchers  an  index  of  NCES  reports  and  bulletins,  contractors  reports,  and 
tabulations  that  Include  Hispanic  indicators  or  categories. 

In  regard  to  developing  and  presenting  tabulations  by  race  and  ethnicity, 
the  collapsing  of  Hispanics  with  other  groups  should  be  avoided  if  at  all  possible. 
For  example,  as  insightful  as  a  recent  NCES  report.  An  Analysis  of  Course-Taking 
Patterns  in  Secondary  Schools  as  Related  to  Student  Characteristics,  was  tor  the 
study  of  course-taking,  it  was  marred,  because  it  collapsed  Hispanic  with  Others. 

The  State  Education  Statistics  wall  chart  is  quite  handy,  especially  the 
challenge  goals,  but  it  should  include  percentages  of  single  parent  households 
and  limited-English-proficient  children  under  population  characteristics. 


584 

572 


HISPANICS  AMD  EDUCATION  DATA 


REFERENCES 

Bould,  Sally 

Unpublished  tabulation  from  March  Current  Population  Survey  of  Household  and 
Family  Characteristics. 

Brown,  George  H.;  Rosen,  Nan  L.;  Hill,  Susan  T.;  and  Olivas,  Michael  A. 

(1980)  The  Condition  of  Education  for  Hispanic  Americans,  National  Center  for 
Educati on  Statistics.    Washington,  u.c. 

DeNavas,  Carmen  and  Fernandez,  Edward. 

(7/27/84)  Condition  of  Hispanic  Women  in  America  Today.  (A  presentation) 
U.S.  DepartTiient  of  Commerce,  Bureau  of  the  Census). 

Hirano-Nakanishi,  Marsha. 

(1983)  Hispanic  School  Dropouts:  the  Extent  and  Relevance  or  Pre-High  School 
Attrition  and  Delayed  Educarforu  (Report  No.  Los.  Angeles:  National 
Center  for  Bilingual  Research. 

Hodgkinson,  Harold  L. 

(1985)  All  One  System:  Demegraphics  of  Education,  Ki ndergarten  Through  Graduate 
School.   Washington,  D.C.:  Institute  for  Educational  Leadership,  Inc. 

Pear,  Robert 

(1984)  "Rate  of  Poverty  Found  to  Persist  in  Face  of  Gains."  New  York  Times. 
August  3. 

U.S.  Department  of  Commerce,  Bureau  of  the  Census'^ 

(1985a)  Household  and  Family  Characteristics:  March  1984.  Current  Population 
Reports,  Series  P-ZO,  No.  398.  Washington,  D.C.:  U.S.  Government  Printing 
Office. 

U.S.  Department  of  Commerce,  Bureau  of  the  Census 

(1985)  Persons  of  Spanish  Origin  in  the  United  States:  March  1982.  Current 
Popul ation  Reports,  Series  P-ZO,  No.  3^5.  Washington,  D.C.:  U.S.  Government 
Printing  Office. 

U.S.  Department  of  Commerce,  Bureau  of  the  Census 

(1984)  Social  Characteristics  of  Students:  October  1983.  Current  Population 
Reports,  Series  P-zo,  No.  344.  Washington,  D.C.:  U.S.  Government  Printing  Office. 

U.S.  Department  of  Education,  National  Center  for  Education  Statistics 

(1984)  The  Condition  of  Education.  Washington,  D.C.:  U.S.  Government  Printing 
Office. 


o  585 


National  Statistics  to  Improve  Educational  Productivity 


Herbert  J.  Walberg 
University  of  Illinois  at  Chicago 


Now  is  the  time  for  the  U.S.  Department  of  Education  to  expand  and 
improve  national,  state,  and  local  statistics  collected  on  education.  With 
justification,  many  national  reports,  including  A  Nation  at  Risk  (U.  S. 
Commission  on  Excellence  in  Education,  1983),  urge  educational  reforms; 
and  sute  legislators  and  other  groups  are  beginning  subsuntial  changes  in 
educational  policies.  Not  only  is  it  in  our  national  interest  to  study  the 
effectiveness  and  efficiency  of  education,  but  the  magnitude  and  effects  of 
current  reforms  deserve  the  closest  scrutiny  during  the  next  decade. 

The  government  role  in  education  may  be  more  complicated  in  the  U.5. 
than  in  other  countries;  the  unique  qualities  of  our  system  may  both  help 
and  hinder  the  effectiveness  of  education  and  the  collection  and  use  of 
statistics.  Unlike  most  other  countries,  we  have  no  centralized  governing 
and  data-gathering  ministery  of  education;  (education  policy  is  largely  a 
state  and  local  responsibility).  Nor  do  we  have,  like  many  other  advanced 
countries,  a  single  centralized  national  agency  to  collect  and  tndlyu  sutistics 
on  education,  business,  health,  agricultural,  cultural,  and  other  maners. 

It  is  not  my  purpose  here  to  take  sides  on  complies  ed  questions  of 
federal,  state « tnd  local  control  of  education;  nor,  for  that  matter «  on  the 
proper  influence  of  school  administrators,  teachers,  parents,  and  students  on 
educational  goals  and  means.  It  should  be  recognized,  however,  that  the  the 
U.S.  Office  of  Education  (predecessor  of  the  Department  of  Education)  was 
created  by  Congrers  earlier  in  the  century  to  collect  statistics  with  a  view 
toward  improving  education.  Today,  moreover,  special  interest  and  political 
groups  ranging  from  liberal  to  conservative  agree  that  valid  data  are 
required  to  formulate  effective  educational  policies  (Cooke,  Ginsburg,  and 
Smith,  1985). 

Meter  Sticks  for  Education 

The  value  of  of  statistical  research  depends  on  valid  comparisons, 
several  of  which  can  usefully  influence  educationJ  policy.  These  include 
comparisons  of  the  U.S.  with  other  countries;  among  the  SO  states;  '^^d 
among  students,  classes,  schools,  districts,  and  regions.  In  principle,  all  of 
these  may  be  "cross*sectionalIy*  compared  at  a  single  point  in  time,  or 
changes  in  them  may  be  longitudinally*  compared  across  years. 

Even  though  education  spending  is  one  of  the  larger  and  growing 
fractions  of  the  gross  national  product,  and  even  though  investments  in 
'human  capital*  may  be  vital  to  future  welfare  (Walberg,  1983,  1984), 
education  statistics  are  fundamentally  invalid  in  several  ways.  The  most 
important  flaw  is  the  lack  of  universalistic,  absolute  measures  of  the  primary 
goal  of  education**leaming. 

Since  Alfred  Binet*s  turn-of-the  century  precedent,  test  developers  have 
normatively  compared  students  to  one  another  rather  than  to  absolute 
standards  of  performance.  They  have  developed  tests  to  reveal  differences 
within  homogeneous  groups  of  students  by  selecting  items  that  about  half 
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the  students  can  correctly  answer  and  which  yield  'normal.-  bell-shaped 
distributions  (or  positively-skewed  distributions  from  easier  "masterv"  test 
intended  to  detect  slower  learners  for  remediation).  Whether  teacher- made 
or  commercially-developed,  such  tests  may  be  administered  tc  intact  classes 
or  even  larger  groups  to  measure  learning  fairly  accurately  but  over  a 
narrow  range. 

A  typical  range  of  correct  answers  on  a  40-item  test  might  be  from  20 
to  40  points  correct,  or  a  ratio  of  two  to  one  between  highest  tnd  lowest 
scores.  But  some  students  might  have  guessed  the  correct  answers  on  a 
fourth  of  the  questions  and  deserved  lower  scores;  and  others  might  have 
been  able  to  demonstrate  more  impressive  knowledge  had  the  test  been 
longer  or  composed  of  more  difficult  items  suited  to  their  ability. 

Such  tests  are  reasonable  if  the  purpose  to  compare  students  within  a 
narrow  group  with  one  another.  Researchers  might,  for  example,  compare 
students  within  a  trade  level,  or  a  school  district  or  state  on  sundardized 
commercial  tetu.  Similarly,  teachers  ordinarily  compare  students  on 
material  covered  in  their  lessons:  Their  studenu  may  be  ranked  relative  to 
each  other;  or  •  percenuge  correct  score  may  be  calculated.  Such  practices 

educators  and  test  developers;  and  it  may  be  be 
difficult  to  think  that  learning  tnd  other  accomplishments  could  be 
distributed  other  than  a  normal  curve  in  a  narrow  range.  A  little  reflection, 
however,  about  the  following  quesUon  and  tasks  iUustrates  the  contrary 

What  distribution  will  result  from  the  following  tasks?  Name  the  streets 
of  Chicago.   Throw  t  discus  as  far  as  you  can.   Prove  mathematical 
L»'eorems.  Name  the  presidents  of  the  U.S.  in  order.  Name  the  capitals  of 
Asian  nauons.  Write  Urdu  verbs  and  French  nouns.  Ptay  as  many  tunes  as 
✓  you  can  on  the  vioUn.  Give  the  rules  of  National  CoUegiate  Debate.  Show 

>^  how  much  weight  you  can  bench  press.  Demonstrate  chess  openings  Put 

your  pocket  money  on  the  table.  Ron  w  far  as  you  can  at  the  rate  of  four 
n*.""**"  P«'  mile.  Count  the  number  of  times  you  have  been  in  trouble 
with  the  police.  Enumerate  the  articles  you  have  written  in  the  school 
newspaper.  List  the  coontries  you  have  visited.  Repeat  the  numbers  read  to 
you. 

Obviously,  few  students  could  approach  maximum  human  performance 
on  these  tasks.  Indeed,  many  would  attain  a  score  of  zero  on  most  tasks, 
although  a  few  would  far  exceed  the  mean  perhaps  by  a  multiple  of  five, 
ten.  or  more.  Human  performance  varies  considerably  more  than  the  usuai 
norm-referenced  tests  can  reveal. 

Absolute  Measures 

These  distributions  are  of  measures  or  counts  of  instances  of  what  might 
be  called  absolute  measures  on  ratio  scales.  They  have  a  definite  lero  point 
and  can  range  over  magnitudes,  some  indefinitely.  They  are  similar  to  the 
absolute  measures  such  as  meters  and  kilograms  in  the  natural  sciences,  time 
and  money  in  economies,  counts  and  measures  of  behavior  and  perception  in 
experimental  psychology,  and  scales  of  ordinary  experience.  Educational 
research,  in  comparing  individuals  to  means,  percentiles,  and  other 
relativistic  norms  of  groups,  hu  denied  itself  absolute  measures  that  have 
made  for  fundamental  underiftandings  and  comparable  empirical  resulu  of 
the  natural  sciences,  and  possibly  great  incmses  in  productivity  such  as 
those  in  agriculture  and  industry. 

The  eminent  psyehometrUt  John  B.  Carroll  (1982)  finds  little 
fundamental  progress  in  menul  testing  since  Thurstone  in  1925  (pp.  67,  77) 
Had  psychometrists  continued  Thurstone's  efforts  to  calibrate  mental 
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abilities  and  tasks  to  chronological  age  and  learning  time,  however, 
educational  productivity  might  be  much  belter  understood  and  optimized 
today,  a  half  century  later.  Before  research  can  establish  the  magnitude  of 
the  dependence  of  academic  learning  on  its  causal  factors  rather  than  simply 
the  sign  of  the  dependence,  it  may  be  necessary  to  develop  adaptive, 
cardinal  measures  of  learning  and  its  factors  over  many  magnitudes.  Such  a 
development,  following  productivity  research  in  agriculture,  heal::  and 
industry,  might  lead  to  similarly  great  strides  in  enlarging  human 
achievement  and  accomplishments. 

Odd]>,  the  models  that  might  be  followed  to  develop  absolute 
educational  measures  vre  outside  the  mainstream  of  academic  measurement. 
Athletic  coaches  and  fans  undoubtedly  have  the  most  accurate  and  wide- 
ranging  statistics;  they  can  compare  speeds,  weights,  ratios  of  wins  and 
losses,  and  other  absolute  indicators.  They  can,  for  example,  easily  compare 
the  times  of  a  lOO-meter  dish  of  people  of  different  ages,  countries,  and 
years.  So  also  cu  someone  who  has  devoted  little  time  to  studying  sprints 
times;  comparisons  and  their  meanings  can  be  readily  understood  by  non- 
specialisu. 

New  training  regimens  in  athletics  can  be  evaluated  and  individual 
performance  over  time  can  be  assessed  according  to  absolute  measures.  It 
seems  that  the  century^s  steady  progress  in  athletics—for  example,  the 
01ympics*-is  in  part  attributable  to  well-defined,  absolute  scales  accurate  to 
many  significant  digits  across  wide  variations  in  performance.  Typing  tests 
of  speed  corrected  for  accuracy  offer  another  useful  precedent. 

What  about  academic  performance?  What  is  lacking  are  absolute 
standards  or  measures  that  would  enable  us  to  compare  children  of  different  f 
ages,  grade  levels,  and  abilities.  It  is  though  each  test  publisher  and  ^eacber 
had  a  different  meter  stick;  and  yet  there  is  no  way  to  equate  them.  Thus, 
test  scores  in  a  California  district  can  not  be  validly  compared  with  a  New 
York  district  unless  the  same  test  happened  to  be  administered  in  both 
districts.  If  a  single  district  switched  tests*  it  would  fee  unable  to  compare 
earlier  and  subsequent  scores. 

If  the  test  publisher  changed  editions  or  *re*normed'  the  test,  then 
comparisons  of  earlier  and  subsequent  scores  are  likely  to  be  invalid  (even 
the  Scholastic  Aptitude  Test  appean  to  have  drifted  in  difficulty  over  the 
last  few  decades).  Similarly,  we  cannot  compare  the  performance  of  third 
and  sixth  grade  students  to  find  out  how  much  they  have  learned  because 
comparisons  are  strictly  valid  for  only  studentt  who  have  taken  the  same  test 
(not  the  forms  for  earlier  and  later  grade  levels);  and  the  tests  are  capable  of 
measuring  only  a  narrow  range  of  a  few  grade  level  equivalents. 

One  possible  solution  is  to  calibrate  items  and  tests  to  national  standard 
tests.  The  National  Assessment  of  Educational  Progress  may  offer  a 
reasonable  basis  of  national  standards;  but  it  represents  only  three  age* 
levels,  9*,  13-,  tnd  17*year  olds.  Expanding  the  National  Assessment  and 
coordinating  it  with  other  large-scale  testing  programs  could  lead  to  a  more 
accurate  picture  of  U.S.  achievement  and  the  possibility  of  a  universal 
'meter-sticks*  of  learning  to  which  other  measurements  may  be  calibrated. 
Given  calibration  formulu  tnd  procedures,  states  and  school  district  staff, 
citizens,  parents,  and  studentt  could  compare  their  scores  with  their  previous 
performance  or  with  the  progress  of  others. 

Computer-Assisted  and  Adaptive  Testing 

Even  NAEP-based  calibration,  however,  would  adhere  to  this  cenniry's 
convention  of  giving  each  child  within  a  class  or  grade  the  same  test,  under 
what  would  be  called  'batch  processing*  in  industry.  A  far  more  efficient 
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and  timc-sa.'ing  approach  is  "tailored-testing"  (see  Carroll,  1982)  which 
flexibly  adapts  test  items  to  students  over  great  ranges  of  abilitv  (rather  than 
the  reverse). 

For  several  decades,  it  has  been  possible  both  in  principle  and  in 
practice  to  program  computers  to  assign  the  most  discriminating  items  to 
each  student*  based  upon  her  or  his  prior  responses  during  the  testing 
session  (Carroll,  1982).  As  few  as  15  tailored  items  can  yield  scores  as 
reliable  as  90  batched  items  suited  to  the  average  student.  Alternatively,  90 
tailored  items  given  in  two  hours  can  yield  very  accurate  assessments  not  in 
one  subject  but  in  all  the  major  subjects  of  the  standard  curriculum.  Or»  90 
items  could  provide  highly  detailed  assessments  of  skills  in  a  single 
discipline,  for  example,  word  choice,  grammar,  spelling,  and  punctuation  in 
written  composition. 

The  increased  efficiency  in  time  use  and  the  computer's  capacit)  to 
record  large  amounu  of  information  make  it  feasible  to  monitor  individual 
i(tudent  progress  more  frequently,  tccurttely,  and  comprehensively.  With  a 
thorough,  continuing  assessment  of  what  each  student  need  to  learn,  it 
should  become  equally  feasible  to  provide  computer-adapted  or  tailored 
instruction.  Such  instruction  is  by  no  means  a  panacea*  but  it  is  among 
those  educational  methods  that  provide  moderately  superior  achievement; 
and  it  has  the  further  advantage  of  saving  students*  study  time  (Walberg. 
1984).  It  can  be  expected  that  hardware  costs  will  continue  to  fall,  while 
software  increases  in  sophistication  and  interest. 

There  is  no  reason  why  schools  alone  should  p/ovido  computer-baswu 
assessment  and  instruction.  It  might  be  argued  that  sinc^  the  schools  have 
changed  their  basic  technology  of  explanation,  recitaticzi.  ud  seatwork  very 
little  since  the  turn  of  the  century,  other  agencies  might  also  be  given  an 
opportunity  to  explore  these  new  opportunities. 

la,  principle,  studentt  and  parents  could  monitor  student  progress  on 
absolute  scales  provided  by  entrepreneurial  public  and  competing  private 
groups.  At  a  current,  one-time  cost  of  a  few  hundred  dollars  for  a  *dumb 
terminal*  (without  programs  and  memory)  and  a  modem  (to  convert 
telephone-acoustic  and  computer- electronic  signals),  they  could  call  a  large, 
"mainframe"  computer  from  their  homes  an  800  or  a  local  number,  take  a 
Uilored  test  on  any  subject,  and  bill  the  cost  of  a  few  dollars  per  assessment 
to  a  private  credit  card. 

Public  and  private  schools,  state  departments  of  education,  and 
proprietary  corporations  could  provide  not  only  assessments  but  instruction 
as  well  in  this  way.  A  state  and  local  community  could  finance  such  a 
system  by  providing  an  education  credit  card  worth,  aay,  S3,n00  per  year  to 
be  spent  on  educational  services  parenu  and  studentt  chose.  These  might 
include  a  mix  of  home  and  school  computer  instruction  as  well  u 
conventional  school  instruction.  State  and  local  educators  could  suggest 
minimum  competencies  and  hours  of  study,  require  performance  levels  for 
passing  from  one  grade  to  the  next  and  graduation,  or  impose  a  great 
number  of  regulations  and  certification  practices. 

Conventional  and  new  services  might  range  from  traditional  instruction 
in  neighborhood  public  schoob  to  computer-based  education  offered  by  in- 
sute  and  out-of-state  public  and  private  schools  and  for-profit  corporations. 
The  services  might  be  provided  in  schools,  shopping  centers,  mom-and-pop 
neighborhood  outlets,  or  in  homes  at  any  hour  of  the  day  or  time  of  the 
year  as  the  need  or  interest  arose. 

It  is  possible  to  program  computers  to  monitor  student  progress  in 
relation  to  activities  on  terminals  and  in  other  educational  experiences. 
Automated  statistical  analyses  can  show  which  activities  lead  to  the  highest 


rates  of  learning.  Nationally^calibrated  absolute  measures  would  enable 
states,  local  districts,  teachers,  parents,  and  students  to  weigh  the  costs  and 
benefits  of  various  activities  in  making  their  educational  plans  and  choices. 

Some  may  find  such  new  forms  of  in<:iruction  very  much  to  their  liking; 
others  may  find  them  undesirable;  that  is  human  nature.  Adaptive  testing 
on  absolute  scales,  however,  can  be  made  carried  out  separately  from  the 
means  of  {.••'•^ruction.  It  can  provide  convenient  measurements  to  assess 
students  and  programs  when  they  seem  needed. 

National  Statistics  by  Computer 

Wassily  Leontief,  Nobel-laureate  economist  and  inventor  of  national 
input-analysis  finds  it  most  difficult  lo  apply  his  methods  here  in  the 
United  States  where  he  first  developed  them:  "The  United  States  is  the  only 
advanced  country  in  the  world  that  does  not  havt;  a  central  statistical  office. 
Each  department  of  the  fovemment  collects  statistics  in  the  area  of  its  own 
particular  interests.  Users  of  such  data  spend  much  of  their  time  trying  to 
reconcile  and  align  information  coming  from  these  different  sources' 
(Leontief,  Duchin.  and  Szyld,  1985.  p.  419). 

Yet,  even  within  the  Department  of  Education,  statistics  are 
uncalibrated,  unsystematically  collected  and  archived,  and  poorly  analyzed  to 
guide  national  and  local  educational  policies.  Another  country  that  keeps 
clost  track  of  national  progress  offers  an  interesting  example  ox*  what  can  be 
done. 

Growing  faster  economically  than  Japan  is  Singapore,  where  physical 
resources  are  scarce  and  "human  capital"  is  taken  very  seriously  by  Prime 
Minister  Lee  Kuan  Yew  and  otben  in  the  central  government.  Officials  in 
the  national  mfnistery  of  education  can  call  up  in  an  instant  any  student*s  or 
young  adult*s  test  records  or  a  mass  of  them  for  comparison  from  national 
computer  bases.  They  can  find  the  most  qualified  person  to  fill  a  particular 
joh,  or  tell  an  American  entrepreneur  or  manufacturer  the  number  of 
trained  people  available  for  various  high-value-added,  growth  industries 
such  as  tourism,  electronics,  and  petroleum  processing. 

It  may  be  argued  that  the  U.S.  may  be  too  big,  diverse,  complicated, 
and  perhaps  fixed  ia  its  educational  ways  to  enact  such  an  innovation. 
Besides,  possible  abridgment  of  freedom  and  confidentiality  are  likely  to 
worry  and  deter  educators  from  something  so  intrusive.  Still,  the  Internal 
Revenue  Service  does  not  seem  to  have  abused  its  vast  powers  to  reveal 
(;onfidentiaI  information;  if  anything,  there  seems  more  need  to  worry  about 
ihe  accuracy  of  the  information  supplied  by  taxpayers.  There  seems  no 
good  reason  to  think  that  meuurement  calibration  and  related  services 
provided  by  the  government  would  violate  pnvacy. 

Citizens,  moreover,  partirularly  poor  and  minority*group  parentt,  seem 
more  anthusiutic  than  the  educational  establishment  for  better 
measurements  and  higher  stsadards.  Conducted  for  business,  civic,  and 
minority  organizations,  for  example,  a  recent  poll  of  1,816  Chicago  residents 
showed  88  percent  feel  that  all  high  school  students  in  the  U^.  should  be  be 
required  to  pass  a  stai^dard  examination  before  being  graduated. 

In  addition,  Clucagoans  overwhelmingly  favored  a  tougher  curriculum 
for  high  schools;  The  lowest-income  groups  most  favored  extending  the 
curriculum  te  more  subjecu;  and  blacks  more  often  than  others  preferred 
the  toughers  requirements  in  science,  history,  and  foreign  languages  for 
college-  and  non*coUege*bound  students.  Of  Chicago  adults  with  children 
in  the  public  schools,  69  percent  said  they  would  send  their  children  to 
privf  le  schools  if  they  could  afford  it  primarily  because  they  would  get  a 
bener  teaching,  attention,  and  discipline  (Walberg  and  Hess,  1985). 
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If  we  start  from  the  premises  that  we  must  inform  citizens  about  their 
schools;  that  educators  should  be  informed  about  their  business  including 
their  costs,  benefits,  and  views  of  citizens;  and  that  better  education 
statistics  may  help  us  to  understand  and  solve  our  educational  problems** 
then  we  need  to  think  about  harnessing  the  vast  powers  of  the  computer,  as 
other  industries  have  done,  to  increase  competitiveness  and  productivity. 
School  districts  and  state  departments  of  education  are  enlisting  computers 
in  central  offices  and  classrooms;  and  it  would  seem  the  proper  role  of  the 
federal  government  to  lend  research  support  and  technical  assistance  to  help 
coordinate  the  efforts.  Comparisons  of  all  sorts  will  be  more  valid,  other 
things  being  equal,  to  the  extent  that  data  are  obtained  uniformly. 

In  addition,  national  hook-ups,  perhaps  sponsored  by  the  federal 
government,  would  make  it  feasible  to  conduct  sample  surveys  of  districts, 
schools,  and  students  directly  by  computers.  Students,  for  example,  could 
rapidly  complete  tailored  tests  and  questionnaires  by  terminal  and  modem. 
In  compensation,  they  might  be  offered  a  small  stipend,  or  at  least  they  and 
their  schools  could  receive  an  immediate  summary  of  results  which  could 
also  be  provided  by  long-distance  telephone  connections  to  state  and  federal 
computers. 

The  further  advantage  is  the  speed  at  which  such  surveys  and  tests  can 
be  completed.  The  time-consuming  steps  of  printing  tests  and 
questionnaires,  mailing,  key  boarding  and  screening  data,  and  the  like  can 
be  skipped.  Even  analyses  can  be  automated. 

Like  Gallop  and  other  polls  of  1,500  respondents  that  provide  reasonably 
accurate  estimates  of  public  opinion  in  the  nation,  direct  sampling  by 
computer  would  make  educational  polls  and  national  assessments  fast  and 
cbeap;  they  would  minimize  the  total  human  time  answering  questions  yet 
provide  more  accurate  estimates  than  far  larger  but  unscientific  surveys. 
Quarterly  or  even  monthly  survey  reports  on  important  measures  could  be 
made  routine  as  they  are  in  commerce  and  industry.  Local,  state  or  national 
assessmenU  of  special  topics  might  be  commissioned  and  completed  in  less 
than  a  month.  In  principle,  we  would  not  have  to  wait  a  year  for  the  Phi 
Delta  Kapnan^s  Gallop  Poll  on  education,  several  years  for  cycles  of  the 
National  Assessment  nor  u  much  as  a  decade  between  International  Studies. 

A  National  Bureau  of  Educational  Standards 

Before  turning  to  the  kinds  of  measures  that  seem  desirable  to  collect,  it 
should  be  acknowledged  that  what  is  called  for  above  is  a  tall  order  as 
compared  with  what  hu  been  planned  and  spent  on  educational  research. 
What  is  spent  on  educational  research  by  other  standards,  however,  is 
minuscule.  Even  if  spending  on  educational  research  amounted  to  SI  SO 
million  annually  (Walberg,  1983),  it  would  be  less  than  .006  percent  of 
annual  educational  spending  on  public  elementary  and  secondary  education 
in  recent  yeara.  By  comparison,  it  is  by  no  means  unusual  for  growing 
corporations  in  competitive  industries  to  spend  5  or  10  percent  of  anr^al 
revenues  on  research  and  development. 

The  costs  of  federal  research  on  defense,  space,  and  medicine  obviously 
dwarf  expenditures  on  educational  research  which  may  pay  greater 
dividends  for  the  nation*s  future  welfare.  As  Adam  Smith  said  and  Japan 
demonstrates,  human  capital  is  just  as  important  as  physical  and  financial 
capital  in  determining  the  wealth  of  nations.  And  it  is  clear  that  education 
can  be  made  much  more  productive  in  increasing  the  ratio  of  its  benefits  to 
cosu. 

To  sustain  the  coherent  programmatic  dat)i  collection  that  seems 
required  nay  require  a  agency  of  the  U.  S.  Department  of  Education.  Such 


an  agency, .perhaps  called  the  "National  Bureau  of  Educational  Standards/ 
would  be  analogous  to  that  first  created  in  Paris  long  ago  for  keeping 
standards  of  weights  and  lengths.  Such  an  agency  would  have  to  be 
carefully  planned  and  und(r  close  scientific  scrutin)  since  it  would  have  to 
provide  precise  definitions  and  measurements  of  education  and  learning, 
which  tend  toward  imprecision,  non*conparability,  and  intractability. 

Such  an  agency  would  need  to  avoid  partisan  stances,  value  judgments, 
and  declarations  of  what  constitutes  adequacy  or  excellence.  Like  the 
National  Bureau  of  Standards  which  provides  physical  standards  for  our 
country,  it  would  have  to  adhere  to  scientific  and  factual  questions  rather 
than  values  stances,  inasmuch  as  it  is  possible  in  education. 

It  is  the  charge  of  the  Department  of  Education  to  collect  statistics.  It 
aopears,  moreover,  that  no  other  agency,  public  or  private,  could  take  on 
the  large  t?sk  of  thinking  through,  commissioning,  and  monitoring  or 
conducting  the  research  required  to  put  such  an  agency  in  place. 

Aside  from  calibration,  a  National  Bureau  of  Educational  Standards 
could  serve  as  the  central  government  repository  anu  publisher  of  statistics 
on  education  in  the  U.S  and,  where  appropriate  and  feasible,  in  other 
countries.  In  additior.,  for  those  who  wish  to  analyze  the  raw  data  rather 
than  examine  pre-digested  summaries,  a  National  Bureau  could  serve,  like 
the  Library  of  Congress,  as  an  archive  of  computer  tapes  of  educational  data 
that  could  be  reproduced  at  cost  by  requests  in  writing,  in  person,  or  by 
telephone  (including  telephone  requests  for  data  transfers  by  computer). 

It  would  have  a  capable  technical  staff  to  archive  data  in  standard 
formats  that  could  reproduced  for  secondary  analysis  by  investigators  in 
universities,  state  departments  of  education,  schools,  and  newsrooms.  In  this 
sense,  it  could  be  modeled  after  the  Institutional  Consortium  for  Political  i 
and  Social  Research  at  the  University  of  Michigan  that  archives  and  makes 
available  major  sociai  surveys  and  public  opinion  polls.  Although  such 
surveys  may  costs  hundreds  of  thousands  if  not  millions  of  dollars,  the  tapes 
and  codebooks  for  any  can  be  supplied  at  cost  a  few  hundred  dollars.  With 
artificial  intelligence,  it  should  become  possible  within  a  decade  or  two  for 
non  •technical  people  to  query  such  data  bases  for  a  few  dollars  by  voice 
over  the  telephone  without  having  mastered  ^rofranuning. 

The  beginnings  of  these  functions  are  already  represented  in  the 
National  Center  for  Educational  Statistics  that  distributes  the  High  School 
and  Beyond  data  on  about  SS,000  sophomores  and  seniors,  their  parenu,  and 
teachers.  In  addition,  the  Educational  Commission  of  the  States  made 
available  ud  Educational  Testing  Service  currently  makes  available  at  cost 
data  on  several*hundred  thousand  13-«  17-year-oIds  and  young  adults 
coUected  in  the  National  Assessment  of  Educational  Progress.  In  addition, 
the  tapes  from  the  many  surveys  of  nearly  SO  countries  participating  in  the 
International  Association  for  the  Evaluation  of  Educational  Achievement 
could  easily  be  copied  and  archived,  as  could  other  surveys  such  as  the 
Gallop  Polls  on  education,  the  Equality  of  Educational  Opportunity  survey, 
the  National  Longitudinal  Survey,  and  the  General  Social  Survey.  These  data 
sets  were  assembled  during  at  a  cost  of  perhaps  $500  million  and  are  largely 
under*analyzed.  A  National  Bureau  could  serve  as  archive,  calibrator, 
synthesizer,  reporter,  and  at-cost  distributor  or  raw  data  and  results. 


Current  Federal  Statistics 


It  has  been  said  that  democracy  is  the  worst  government  except  for  all 
other  forms.  The  same  may  be  true  of  current  statistics  the  U.S. 
Department  provides.  Therefore,  we  should  be  loath  to  stop  collecting  any 
data  series  in  education  that  his  already  been  started,  even  on  things  that 
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have  seemed  of  little  bearing  on  learning.  If  anything,  we  must  expand  the 
collection  and  coordination  of  data,  and  encourage  scholars  and  others  to 
anabze  the  costly  and  valuable  statistics  that  are  currently  available. 

Federal  government  spending  on  education  statistics,  however,  is  small 
by  several  standards.  In  school  year  1982-83,  for  example,  spending  on 
public  elementary  and  secondary  schools  in  the  U.S.  by  federal,  state,  and 
loc;i  government  was  respectively  $56,  52,  and  8  billion,  which  comes  to  a 
total  of  SI  16  billion,  which  is  4.5  percent  of  the  S2.6  national  income 
rindicators.  I985«  p.  22).  If  the  federal  government  spent  Si 00  million  on 
better  educational  statistics,  it  would  be  amount  to  le^s  than  one*tenth  of 
one  percent  of  total  educational  spending  on  public  schools  and  might 
increase  efficiency  by  many  billion.  Given  U.S.  government  spending  of 
Sl.^  billion  on  statistics  (Alonso  and  Starr,  1985,  123),  education's  4.5  percent 
share  (based  on  the  public  school  percent  of  national  income)  would  be  S63 
million,  in  contrast  to  S8.7  million  in  current  spending  by  the  National 
Center  for  Educational  Statistics.  Higher  spending  should  yielo  better 
statistics  and  make  the  "education  industry"  more  comparable  to  agriculture, 
medicine,  and  various  industries  that  base  practice  upon  productivity 
comparisons. 

Even  the  aggregate  and  crude  numbers  on  costs  and  enrollments  now 
compiled  by  the  federal  government  from  data  supplied  by  the  states  can 
raise  pointed  questions.  For  example,  the  1985  Indicators  published  by  the 
U.S.  Department  of  Education  shows  that  an  average  of  S2,948  was  spent  on 
each  of  the  39.6  million  children  in  public  schools  in  1982-83  (p.  22).  (By 
comparison,  according  to  Feistritzer,  1985,  the  average  per-student  costs  of 
Catholic  schools  in  1982*83  was  S782;  and  private  school  tuition  was  SI, 029.) 

Public  school  teachers  reported  an  average  of  24  students  in  their 
classes;  and  the  average  ntio  of  students  to  all  full-time  equivalent  teaching 
staff  (which  includes  special  teachers)  wu  19.  So,  depending  on  the 
estimate,  per-student  annual  spending  was  S55  or  $70  thousand  per  teacher 
(p.  30).  Teacher  earnings,  however,  were  about  Sl9  thousand  indicators. 
1985,  p.  30).  or  only  about  a  quarter  or  a  third  of  total  costs  (actually  the 
true  fraction  must  be  even  smaller,  since  complete  earnings  which  includes 
moonlighting  and  summer  work  are  included  as  earnings). 

Thus,  indirect  costs  in  public  schools  are  apparently  two  or  three  times 
as  high  as  the  direct  educational  services  provided  by  teachers.  Where  is 
this  extraordinary  amount  of  money  going  if  not  to  teachers?  Does  it 
account  for  the  approximate  500  percent  increase  in  inflation-adjusted,  per 
student  costs  since  1930?  Has  acidemic  achievement  gone  up  accordingly? 
Is  what  is  being  provided  by  indirect  costs  as  valuable  to  students  as 
teaching  services?  Does  it  help  teachers  to  do  their  jobs  more  efficiently? 
Can  it  be  going  to  physical  facilities  during  a  period  of  declining 
^enrollments?  If  it  is  goicg  tw  administrators,  can  such  heavy  bureaucratic 
spending  be  justified?  Are  federal  and  state  governments  creating  local 
bureaucracies  to  deal  with  special  programs  and  complex  regulations?  Do 
any  of  these  explanations  fit  with  corporate  trends  toward  lean,  competitive 
organizations  with  the  most  senior  administrators  close  to  customers  rather 
than  layered  away  from  them  by  corpulent  staffs? 

Whatever  the  answers  to  these  questions,  the  numbers  ther  selves  are 
provocative;  they  stimulate  discussion  and  research.  Such  data  should  be 
easily  accessible  so  that  the  public  and  educators  can  deliberate  about  them. 
It  is  important  to  keep  accurate  tabulations  of  them  over  the  years  so  that 
we  can  better  understand  how  the  levels  of  learning  are  changing,  what  is 
and  is  not  changing  them,  and  what  might  be  done  to  increase  effectiveness. 
We  should  be  reluctant  to  omit  any  just  as  the  Library  of  Congress  avoids 
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dropping  subscriptions  of  unfashionable  magazines. 


The  Quality  of  Federal  Statistics 

Even  though  we  should  continue  and  expand  the  collection  of  statistical 
series,  we  must  be  duly  cautious  and  consider,  is  Aristotle  advised,  the 
source.  The  British  sutistician  S,.  Josiah  Charles  Stamp  (1880-1941)  warned: 
"The  government  are  very  keen  on  amassing  statistics.  They  collect  them, 
raise  them  to  the  nth  power,  take  the  cube  root  and  prepare  wonderful 
diagrams.  But  you  must  never  forget  that  ever>  one  of  these  figures  comes 
in  the  first  instance  from  the  village  watchman,  who  jiist  puts  down  what  he 
damm  pleases"  (quoted  in  Alonso  and  Starr,  1985,  p.  123). 
Cooke,  Ginsburg,  and  Smith  (1985)  compiled  several  alarming 
discrepancies  in  estimates  in  important  national  statistics  on  and  related  to 
education.  School  safety  and  security,  for  example,  have  found  to  be 
related  to  learning  gains;  but  how  safe  are  students?  The  National  Crime 
Survey  administered  by  the  U.  S.  Department  of  Justice  seems  to  indicate 
from  household  interviews  that  about  10  percent  of  junior  and  senior  high 
school  students  are  victims  of  assault,  robbery,  or  theft  each  vear.  The 
National  Institute  of  Education,  however,  reported  from  confidential 
answers  by  students  in  their  classrooms  that  10  percent  were  victimized  each 
school  month— an  estimate  at  least  ten  times  larger  than  the  Department  of 
Justice  estimate  based  on  parent  interviews  about  their  children. 

Similarly,  the  U.S  Department  of  £ducation*s  Vocational  Education  Data 
Systems  reported  741  thousand  New  Jersey  students  taking  high  school 
vocational  education  courses  in  1979--a  number  that  exceeded  the  State*s 
high  school  enrollment  by  more  than  SO  percent.  In  Virginia,  the  29 
thousand  Indians  which  VEDS  indicates  as  enrolled  in  vocational  education 
represents  more  than  three  times  the  total  Indif^  population,  according  to 
the  Sute  Indian  Commission. 

Even  well  researched  variables  in  the  mainstream  of  educational  reform 
movement  are  suspect.  Instructional  time  in  the  United  States  is  rarely  more 
than  60  percent  of  the  school  day,  but  the  share  varies  by  more  than  2  to  1 
among  schools,  kzd  engaged  time  is  only  a  varying  fraction  of  allocated 
time,  according  to  Cooke,  Ginsburg,  and  Smith  (1985).  Japan*s  high  schools 
may  employ  twice  as  n:uch  engaged  time  in  the  four  yean  of  high  school 
(including  extramural  suidy)  to  yield  achievement  equivalent  to  the  U.  S. 
bacchalaureate  in  mathematics,  science,  geography,  native  and  foreign 
languages,  and  music  as  well  u  non*academic  pursuits  (Walberg,  Puchal, 
and  Weinstein,  1985).  It  is,  however,  difficult  to  get  more  than  ball  park 
estimates  of  these  important  comparisons. 

In  Illinois,  perhaps  because  of  inflation  of  course  titles  or  blurring  of 
content,  80  percent  of  the  high  school  studentt  reported  taking  geometry, 
but  a  census  of  actual  transcripu  in  the  State  revealed  that  only  a  quarter 
had.  In  California,  99  percent  school  attendance  is  reported;  but  students 
who  have  *valid*  excuses  there  are  reported  as  in  school**a  far  different 
definition  is  given  in  other  states  (Cooke,  Cinsburf  and  Smith,  1985). 

It  may  be  hoped  that  different  means  of  reporting,  biases  of  the 
reporters,  and  random  factors  may  balance  out  and  permit  at  least  rough 
comparisons  across  respondents,  states,  nations,  and  time  periods.  But  it 
remains  a  vague  and  often  patently  false  hope;  and  the  discrepant  estimates 
of  Cooke,  Ginsburg,  and  Smith  (1985)  may  chime  the  thirteenth  hour  on  the 
educational  statistics  clock  for  soms  important  figures.  "Lies,  damn  lies,  and 
statistics*  said  Benjamin  Disraeli  and  Mark  Twain. 
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Science  offers  several  ways  to  assess  and  solve  such  statistical  problems; 
they  deserve  the  support  of  a  National  Bureau  of  Educational  Standards. 
One  is  to  insist  that  highly  det&iledt  explicit,  and  publicly  accessible 
descriptions  of  data  definition  and  collection  procedures.  Another  is  to 
commission  papers  and  convene  conferences  to  criticize,  design,  and  re* 
design  large  national  and  international  sample  surveys.  To- some  extent, 
these  are  major  functions  of  refereed  journals  and  associationi  in  the  natural 
sciences  and  their  applications.  They  are  often  funded  by  U.  S.  government 
agencies  such  as  the  Department  of  Agriculture,  Department  of  Health  and 
Human  Services,  and  the  National  Science  Foundation  in  the  such  cases  of 
expensive  health  and  productivity  surveys  and  massive  projects  in  physics. 

National  groups  of  blue*ribbon  layman  or  practicing  professionals  have 
tried  to  carry  out  these  functions  in  preparing  recent  national  reports  on 
education.  They  have  employed  school  visitt,  hearings,  and  a  selection  of 
expert  testimony  and  papers.  Democratic  societies  should  allow,  indeed, 
encourage  non-technical  deliberation  and  formulation  of  policy.  Public  and 
private  commissions  should  deliberate  and  recommend  goals,  values,  and 
means,  which  may  be  enacted  by  legislators,  private  agencies,  and 
individuals. 

But  such  groups  should  have  accurate  statistics  as  one  basis  of  their 
deliberations.  They  may  not  have  the  technical  competence  to  gather  and 
assess  the  statistical  facts;  and  technical  experts  may  not  be  able  to  see 
beyond  the  facts  to  the  public  interest.  In  view  of  the  limits  of  human 
time,  skills,  and  knowledge,  some  specialization  of  function  is  required.  A 
r  National  Bureau  of  Educational  Standards  should  be  restricted  to  collection 

and  assessment  of  data,  calibrating  and  correlating  measures,  commissioning 
large-scale  studies,  making  information  available,  and  criticizing  it  In  this 
way,  it  may  provide  good  data  for  policy  analysts  anJ  decision  makers. 

It  should,  however,  avoid  political  stances  and  recommending  of  policies 
and  practices.  The  National  Bureau  of  Standards  accurately  tells  us  how 
long  yards  and  meters  are,  not  how  long  our  houses  or  apartments  should  be. 
The  Department  of  Labor  gives  the  incomes  of  occupational  groups  (with  a 
margin  of  error)  not  evaluations  of  what  income  distributions  should  be; 
when  it  gets  beyond  the  uce/uinable  facu  to  such  predictions  as  the 
number  of  mechanical  engineers  required  in  ten  years,  it  is  often  wrong. 
The  Department  of  Agriculture  can  give  the  average  corn  yield  of  Iowa 
farmland  and  the  increments  associated  with  degrees  of  tillage,  irrigation, 
and  fertilizer,  but  the  farmers  decide  how  to  farm.  These  seem  instructive 
precedents. 

What  Educational  Data  Needs  Collecting? 

Followiag  the  lead  of  early  agricultural  experimentation,  much 
educational  research  focuses  on  the  relation  of  single  causes  and  effects. 
Education,  however,  obviously  involves  many  means  and  ends,  each  with  an 
explicit  cr  implicit  cost  or  value.  The  promotion  of  efficiency  requires  the 
specification  and  meuurement  of  the  chief  causes,  means,  or  "factors*  of 
productiou. 

Experiments  and  statistical  studies  of  productivity  dau  together  with 
cost  and  value  estimates  have  enabled  a  wide  variety  of  industries  to 
increase  the  value  of  their  output  while  simultaneously  reducing  costs 
thereby  raising  human  welfare.  Although  such  thinking  may  seem  alien  to 
some  educators,  the  public  ranks  research  on  educational  effectiveness 
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higher  in  priority  thtn  most  other  fields  of  scientific  investigation  in  the 
natural  and  social  sciences  (Walberg,  1983);  and  educators  may  do  well  to 
think  more  explicitly  tnd  unsentimentally  about  our  business  and  to  try  to 
found  it  on  the  emerging  consensus  of  scientific  evidence. 

It  should  also  be  said,  however,  that  *e  educators  are  far  from 
estimating  explicit  costs  and  values.  The  prior  problem,  now  being  solved, 
is  estimating  the  magnitudes  of  effects  of  educational  inputs  on  outputs 
which  primarily  involves  causal  rather  than  value  questions.  If  i$  these  chief 
causes  and  effects  that  deserve  first  priority  in  national  data  archives. 

Nine  factors  require  optimization  to  increase  affective,  behavioral,  and 
cognitive  learning  (see  Walberg.  1984.  and  the  cited  references  for  a  more 
detailed  discussion).  Potent,  consistent,  and  widely  generalizable.  these  nine 
factors  fall  into  three  groups: 

Student  aptitude  includes: 

1)  Ability  or  prior  achievement  as  measured  by  tne  usual 

standardized  tests. 

2)  Development  as  indexed  by  chronological  age  or  stage  of 

maturation,  and 

3)  Motivation  or  self  concept  as  indicated  by  personality  tests  or  the 
student's  willingness  to  persevere  intensively  on  learning  tasks. 

Instruction  includes: 

4)  the  amount  of  time  students  engage  in  learning  and 

5)  the  quality  of  the  instructional  experience  including  psychological 
and  currieular  aspecu. 

Four  environmental  facton  also  consistently  affect  learning: 
the  educationally-stimulating,  psychological  climates  of 

6)  the  home, 

7)  classroom  social  troup,  and  8)  the  peer  group  outside  school; 
and 

9)  flainimal  leisure-time  television  viewing. 

The  first  five  aspects  of  student  aptitude  and  instruction  are  prominent 
in  th^  educational  models  of  Benjamin  S.  Bloom.  John  B.  Carroll,  Robert 
Glaser,  and  others.  Each  appears  necessary  for  learning  in  school;  without 
at  least  a  small  tmoimt  of  each,  the  student  can  learn  litUe.  Large  amounts 
of  instruction  and  high  degrees  of  abUity.  for  example,  may  count  for  Uttle 
if  students  are  unmotivated  or  instruction  is  unsuitable. 

These  five  essential  factors,  however,  are  only  partly  alterable  by 
educators  since,  for  example,  the  curriculum  in  terms  of  lengths  of  time 
devoted  to  various  subjecu  and  activities  is  pertly  determined  by  diverse 
economic,  political,  aad  social  forces.  AbiUty  and  motivation,  moreover, 
are  influenced  by  parentt,  by  prior  learning,  and  the  studenu  themselves. 
Thus  educators  are  unlikely  to  raise  achievement  substanually  by  their  own 

the'remaining  factors-the  psychological  climate  of  the  classroom 
iroup-  enduring  affection  and  academic  stimulation  from  adulu  at  home; 
and  an  out-of-school  peer  group  with  learning  interests,  goals,  and  acuviues- 
-intluence  learning  in  two  ways:  Studenu  learn  from  them  directly;  and 
these  factors  indirectly  benefit  learning  by  raising  student  ability, 
motivation,  and  responsiveness  to  instruction.  In  addition,  about  ten  (not 
the  more  typical  30)  weekly  hours  of  television  viewing  seem  optimal  for 
learning,  perhaps  because  more  television  time  displaces  homework  and 
other  educationally-constructive  activities  outside  school. 

The  major  causal  infiuences  fiow  from  aptitudes,  instruction,  and  the 
psychological  environment  to  learning.  In  additioa.  however,  these  factors 
also  influence  one  another,  and  are  also  infiuenccd  in  turn  by  how  much 
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motivation,  ibility,  or  instructional  quality  is  minimal.  Thus,  no  single 
essential  factor  overwhelms  the  others;  all  appear  important. 

Althoush  the  other  factors  are  consistent  statistically-  or  experimentally- 
controlled  correlates  of  academic  learning,  they  may  directly  supplement  as 
well  as  indirectly  influence  the  essential  classroom  factors.  In  either  case, 
the  powerful  influences  of  out-of-school  factors  especiair;  the  home 
environment  must  be  considered. 

For  example,  the  12  years  of  180  6-hour  days  in  elementary  and 
secondary  school  tdd  up  to  only  tbout  13  percent  of  the  w-aking,  potentially- 
educative  time  during  the  first  18  years  of  life.  If  more  of  the  87  percent  of 
the  student's  waking  time  nominally  under  the  control  of  parents  that  is 
spent  outside  school  were  to  be  spent  in  academically-stimulating  conditions 
in  the  home  and  peer  group,  then  the  total  amount  of  the  student's  total 
learning  time  might  be  dramatically  raised  beyond  the  13  percent  of  the 
time  in  conventional  American  schools.  ,  , 

For  instance,  the  average  of  28  hours  a  week  spent  viewing  television 
by  high  school  students  might  usefully  be  added  to  the  mere  4  or  5  weekly 
hours  of  homework  (Walberg  and  Shanahan.  1983).  Europeans  and  Japanese 
believe  homework  helps  learning;  empirical  results  of  American  research 
support  their  belief. 

The  numerical  results  of  ayntheses  of  the  effects  in  several  thousand 
studies  of  academic  learning  conducted  during  the  past  half  century. 
Interested  readers  and  those  who  wish  technical  details  may  examine  the 
findings  and  methods  reportfd  in  the  compilations  of  these  syntheses  (cited 
in  the  references  in  Walberg.  1984,  which  in  turn,  conuin  references  to  the 
original  studies.  (In  several  insunces,  separate  estimates  of  correlations  and 
effects  are  available  for  science  and  mathematics  because  the  National 
Science  Foundation  awarded  grants  for  special  synthesis  projecu  on  these 
two  subjects.  The  tables  conuin  both  effects  and  correlations,  and  the 
correlations  assume  a  one-  standard  deviation  rise  in  the  independent 
variable.) 

Sample  survey  items  and  descriptions  of  sets  of  items  from  High  School 
and  Beyond,  the  National  Assessment  of  Educational  Progress,  and  the 
International  Association  for  the  Evaluation  of  Educational  Achievement 
provide  national  and  international  baselines  in  various  years,  and  theyshould 
be  considered  as  candidates  on  this  ground  alone.  Better  items  and  direct 
observations  can  also  be  developed  and  used. 

Beyond  Academic  Achievement 

If  education  proceeds  by  fads  rather  than  cumulative  research,  it  will 
fail  to  make  the  great  advances  in  productivity  that  have  characterized 
agriculture  nnd  industry  in  this  century.  It  may  be  argued,  however,  vhat 
education  is  a  complex  subject  and  cannot  be  reduced  to  a  few  external 
benefits  or  measures  of  outcomes.  This  argument  also  applies  to  any 
enterprise:  The  desirabUity  of  an  automobile  cannot  be  reduced  to  numbers 
on  its  speed  and  power;  busheU  of  corn  per  acre  need  to  be  considered  in 
the  light  of  percentage  of  protein  per  unit  weight,  predicted  prices,  fuel 
requirements,  human  labor,  and  the  like. 

Similarly,  better  nationally-calibrated  measures  of  achievement 
including  factt  and  'higher-order  skills'  in  English,  mathematics,  science, 
civics,  history,  foreign  languages,  art,  and  music  and  what  produces  them 
would  be  a  great  accomplishment.  But  they  would  hardly  suffice  and  may 

be  misleading.  ^  .i     .•  ,i 

A  synthesis  of  the  relation  of  conventionally-measured  educational 
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correlation  of  .155  of  rhese  * .  8'°"P'  "  average 
such  as  income  , elf. ratld  hln"  "^  life-success  indicator! 
ind  self-.  peer:;:Ld  ,upJrIS?-«!Lrn?  '"'^  o^put  indexe 
only  .boat  2.4  percent  ofThe  vaH.n?!  ?n  effectiveness.  Thus 
-as  predicuble  from  gfad«  g:ve;T;XlSr?  °' 

balan^e^bVJe^Tcotnufn/'^^^^^^^^^^  """chers  to  seek  a 

to  learn  new  task,  «  an  indivTdua^  «^Ponsibility.  and  skill 

mastery  of  teacher-chosen  t«tioSJ  k„ow,^^^^^  °°  °"  ''"^ 

tests  that  may  ,oon  be  obsolete  cr  for»o»J;  *  v""'""'^  °"  conventional 
to  think  again  .bout  how  cVvi  v^Sr^^^^^^  need 
entrepreneurship  and  the  Uke  th«  SJ^^I!  •  '  v*""  cooperation, 
lexicon  might  be  measured  Md«co"^^^^^^  psychological 

«d?trde?u%?g':fiX^^^^^^^^  education,  in  which  teachers 

Open  educators  lied  ^  encourJie  IducS^^^^^^    T^^'  ^ould  learn, 

parent,  student,  .nd  achool  board  J?'"""  »e«her. 

thinking.  ,elf  reliance.  coM?r„ctWe  .tStud.^^      V  "itical 
objectives  seldom  cons  derS  bv  w^eS  »  °' 

survey,  in  Western  co?ntr  «  iwluX  S^^^^  '         """a^y  of 

that,  when  given  a  cSe  edSc.to«*«^  *  "'^  ""'"^  States,  shows 

•bove  teat  score,  ^d  W^h  "jSi!,      '  '"^  «o^» 

•duc&S^^^^^^^  .tudies  of  open 

achievement,  locu,  ofcon^l  .j|f^«-^^^  '^^'^  ^  «'o  for 
difference  bitl^S  ow^^'' "'f  ^^'^f^P*'       *«iety  (which  ,ngge,t,  no 

psychological  ad?u,tm?nt."it?de  Jii^rj?  '''''''^^-^  ^^'^  -2  ^ "r 

Md  general  mental  abS  ty       ^n^t^S''***'''  "'io«ty. 

creativity.  ,nd  independinc'e   ih^  cooperaUvene,,. 

BO  worse  in  ftandardized  ^Wev^ren^  »«8htJy  or 

•everal  outcome,  th«7duSS„  modentely  better  on 

value.  Thu,.  thi,  re^tly^.^thesS;  "^^^  »°  °f 

standard  outcome,  i?d  ?e«SXS  «  th^?  cT.^^^^^^^ 

Becemrfly  enhance  or  trid«-oSr  . .?;..!       conventional  mea,ure,  do  not 

Another^cedenT^St  «"con /entionnl  accomplijhment,. 

effort  begYn^X, loder  i,r.;l^^^^^^^  «nt 
Education    Sweden  J  fort„«?,."  "J*'''.  Miniatery  of 

«e«ured  in  1961  a?  p^pJS™  „V.K.^^K^      longitudinal  aample  fir, 
»48.  Who  ire  now  n5Sn?4?IL^ro?t^^^^  25th  of  aU  month,  of 

intemaUonally  impt^t'terii^  IIT,  ^V"*'  "  **«^'^°«  " 
early  Mhool  and  otht^nJ^^c^'^i^ji^'*  ^^^^  «o  diacover  how 
Of  about  120  adult  chiiiiKS^  7^!^!!!!,  V""  '"e'^'edge  «>d  anitudes. 
correlation,  with  !m!^TT'.lL^Zn  5^?'***'^  P*'*^"^ 
intelligence,  uid  20  with  ixial  LckgrJ!?,?  '  "^''^ 

exam'iltmSSnn^  ^^0^^^^^^  -'»^»ore  education,  for 

knowledge  and  more  inff^Iit:  !^  P'o^^ded  them  with  new 

Amount  If  educaTon%^"Sve,v  J^Ti^n condition,. 
•»  going  to  theaterr,n7conierr^ind 

•entertainment"  through  weekiv  mV«^        neg,t,vely  correlated  with 
M.r.  W.K„  - 
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in  repairing  .  car;  tnd  having  better  informat.on  on  f ^jf  f^^^J; 

less  about  seeking  economic  support  from  Ta«^^ 

educated  men  and  women  used  more  words,  more  different 

percentage  of  words  with  more  than  10  letters;  and  they  required  fe^er 

interviewer  interventions  to  complete  their  responses. 

ri-rnqvist's  is  •  pioneering  longitudinal  investigai.on.  Since  the  effects 
.f  educaUon  may  no?  turn  up  immediately,  except  o^.^^JJ-'/^^^^^^ 
and  less  well  on  other  measures,  we  need  more  such  'on8-term  sti^dies  that 
wlate  adult  characteristics  to  educauve  experiences  tnd  activi  ies  within  and 
outsfde  school  We  .re  fortunate,  indeed,  "'tve 
that  shows  the  influence  of  amounts  of  education;  but  we  Jike  to  haxe 
more  specific  measurements  of  e.rly  and  later  "/.J^ 
hobbies  and  prizes  won.  and  experiences  such  as 

hours  books  read  at  leisure,  family  activities.  Uips  abroad,  military  ser%.ce 
anS  thriike.  These  would  enable  us  to  relate  early  characteristics  and 
experience  to  later  achievements  and  attitudes. 

Conclusion 

The  present  seems  a  time  for  great  opportunity  in  educational  reform 
and  research  in  education.  Agriculture,  engineering,  and  medicine  made 
g  eat  s  ides  ii  improving  human  welfare  as  doubts  arose  'bo^  tradition 
Satural.  and  mystical  practices,  as  the  widened  "easurement  of  results 
"ntensrfied.  as  experimental  findings  were  synthesized,  and  as  their 
iSeoretical  and  practical  implications  were  coordinated  and  vigorously 

'°'''S?o"Vn7'S?  open  to  humanistic  and  scientific  inquiry  and  no 
lower  inTrlori.?  .ince  half  Uie  workers  in  »°dern  nations  ^e  in  know^^^^^^^ 
Industrie?,  and  the  value  of  investments  in  f  °* 

than  ever  (Walberg.  1983).  Although  it  is  P°«»W\"J»°VSS  od  of 
federri  statistics  on  eduction,  the  last  decade  or  '  /^^^^^^^^ 

quiet  but  significant  accomplishments;  and  larger  amounts  of  valuable  data 

^el'enTyThlf^Jional  Research  Council's  Committee  o.  Indicators  of 
PrecoUege  Science  and  Mathematics  EducaUon  '^^^^^^^^^^i^t 
national  measurement  and  tracking  of  Je  many  f ""f.^'^lif  u  S 
factors  and  outcomes  discussed  above  (Raizen  and  Jones.  1985).  The  u.a. 
{LTartmSnt  of  Education,  working  with  16  education  organizations,  has 
SeadTdevetoLd  a  plan  for  lystemaUdly  coUecting  outcome,  process,  and 
S,n.ext  dauaTd  issued  itt  firS  report.  Tnrtinton  nfFJa'^H^JS" 
Treni  H985)  This  contains  a  series  of  datt.  presented  both  m  ubles  and 
JiShf  ove7to™h?wTthe  course  of  education  measures  over  several 

''"SSth  reports  continue  our  tradition  of  collecting  "^^'f  "^^'^J 
spending  dau;  but  go  beyond  it  in  recommending  (in  the  case  *e  ^RC 
rwrt)  and  Splaying  (in  the  DE  report)  changes  in  test  »««"*^?J^ 
c^mSiSSns  of Uievement.  remedial  coUege  course  enroUmeno  cl^  sites 
tJSSi  abilities  of  the  teaching  force,  publicopinion  ^^^jj 
.t.t»  reouired  curriculum  unitt.  These  reportt  give  us  hope  that  we  may 
r"  ch  co««su^^^^^^^^^  me«ures  of  learning  and  of  the  produc„ve 

facwrs  that  bear  upon  it.  and  that  a  national  bureau  might  be  founded  to 
col  ect  coordinate,  calibrate,  archive,  analyze,  synthesize,  and  make 
Swe  5he  iu  thit  is  needed  to  improve  educational  producuvity. 
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Appendix 


illusJ^ffo        "^"^  contains  several  tables  that 
fir^n^f   *  the  magnitudes  of  effects  of  productivity 

°"  ^fJ^ieveinsnt  revealed  by  quantitative  syntheses 

E    ^ '^^^^^^^^  SfffSt-o^J- J" 

um^uJZr^'  7    w  and  Shanahan,  1983;  and 

Walberg,  Hamisch,  and  Tsai,  1984). 
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Table  1 

Influences  of  Aptitudes  on  Learning 


Aptitude 


Effect 


Size 


Ability 

IQ  .71 

IQ  (Science)  .48 

Developnent 

Piagetian  Stage  .47 
Pia.  Stage  (Science)  .40 

Motivation 

Motivation  . 34 

Self -Concept  .18 


xmxxx 
xxxxx 


xxxxx 
xxxx 


XXX 
XX 


Note:  The  X  siTrbols  represent  the  sizes  of  the 
correlation  coefficients  in  numbers  of  tenths. 
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Table  2 

Instructional  Quality  and  Time  Effects  on 

Learning 


Method  Effect  size 

Reinforcement  1.17  XXXXXXXXXXXX 

Acceleration  i.oo  XXXXXXXXXX 

Reading  Training  .97  XXXXXXXXXX 

Cues  and  Feedback  .97  XXXXXXXXXX 

Science  Mastery  .81  XXXXXXXX 

Coop«rativ«  Programs  .76  XXXXXXXX 

R*ading  Exptriatnts  .60  XXXXXX 

Personalized  Instruc.  .57  XXXXXX 

Adaptive  Instruc.  .45  XXXXX 

Tutoring  . 40  xxxx 

Individualized.  Science  .35  XXXX 

Higher-order  Questions  .34  XXX 

Diagnostic  Prescription  .33  XXX 

Individualized  Instruc.  .32  XXX 

Individualized  Math.  .32  XXX 

New  sci«nc«  Curricula  .31  xxx 

Teacher  Expectation  .28  xxx 

Conputer-Assis.  Instruc.  .24  XX 

Sequenced  Lessons  .24  XX 

Advanced  Organizers  .23  XX 

Hew  Math.  Curricula  .18  XX 

Inquiry  Biology  .16  XX 

Rcoogeneous  Croups  .10  X 

Programmed  Instruc.  -.03 

aass  Size  -.09  -X. 

Mainstreaming  -.12  -x. 


Instructional  Time  .38  XXXX 


Note:  The  X  symbols  represent  the  sizes  of  effects  in 


tenths  of  standard  deviations. 
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Table  3 


Hone,  P«^er,  Class  Morale  and  Media  Effects 


Method 

Effect 

Graded  Homework 

.79 

xxxxxxxx 

Class  Horede 

.60 

xxxxxx 

Hone  Inter/entions 

.50 

xxxxx 

Hone  Environment 

.37 

xxxx 

Assigned  Homework 

.28 

XXX 

Socioecon.  Status 

.25 

XXX 

Peer  Group 

.24 

XX 

Television 

-.05 

X. 

Note:  Iha  X  sysibolB  represent  the  sizes  of  effects  in 
tenths  of  standard  deviations  or  correlations. 
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Variable  Descriptions  and  Sample  Characteristics 

Operational  Definition.  Iniernal  Consistenc).  Sample  Paraphrased 
Items.  Scorin|.  Percent  of  Sample  in  Each  Caif'pry  (when 
applicable) 

Based  on  Sample  of  2.294  Students 


Achievement 


Interests 


SES 


Traditional 
instruaion 


Home 
environment 


Sex 


Fifty-five  items  assessing  student  achievement  in 
five  content  categories  and  four  cognitive- 
process  levels.  Alpha  iniernal  consisienc) 
reliabihi)  ■  .92. 

Three  sdf-report  items  probing  student  «>illing- 
ness  to  study  mathematics  not  pan  of  a 
classroom  assignment.  Alpha  internal  consis- 
tency reliability  -  .47.  "Ho%k  often  did  you 
work  ahead  in  your  mathematics  book?"  "Ho« 
often  did  you  do  mathematics  problems  that 
^ere  not  assigned?"  "How  often  did  you  study 
mathematics  topics  that  were  not  in  the  text- 
book?" Coded:  3  -  often.  2  ■  sometimes.  I  ■ 
never,  blank  ■  no  response  or  missing. 
Highest  amount  of  either  parent's  education. 
Coded: 

1  -  Not  a  high  school  graduate  (15.6^) 

2  -  Graduated  high  school  (34.g^) 

3  -  Post  high  school  (44.9^) 
blank  ■  Unknown  or  missing  (4.1%%) 

Two  items  on  traditional  instructional  methods. 
Alpha  interna]  consistency  reliability  ■  .55. 
"How  often  has  each  of  the  following  been  used 
in  the  cocrscs  you  are  taking  this  year?" 

1.  Listening  to  the  teacher's  Icaure 

2.  Studying  from  textbooks 

Coded:  3  ■  frequently.  2  ■  fairly  often.  I  ■ 

Twelve  items  on  home  charaaerisiics.  Alpha 
internal  consistency  reliability  -  .66.  "Which  of 
the  following  do  you  have  in  your  home?" 

1.  Newspaper  received  regularly 

2.  Magaanc  rccavcd  regularly 

3.  More  than  25  books 

4.  Encyclopedia 

5.  Dioioaary 

6.  Record  player 

7.  Tape  recorder  or  cassette  player 
I.  Typewriter 

9.  Vacuum  cleaner 

10.  Eleahc  dishwasher 

1 1.  Two  or  more  can  or  trucks  that  run 

12.  English  spoken  most  often  at  home 
CodedrO  -,do  not  have.  I  ■  have,  blank  -  no 
response  or  missing. 

Coded:  I  -  female  (51. 5%>.0  -  maie<4l.5^) 
Coded:  I  •  whhe(ll.l%).0  -  noc  white 
Coded:  I  -  black  (12.7%).  0  -  not  black 
Coded:  I  •  Spanish  heritage  (4.1%),  0  -  not 
Spanish  heritage 


Student- 
center  cd 
instruction 


Stimulation 


Number  of 
math 
courses 


Highest  course 


Homework 


TV 


seldom  or  never,  blank  ■  no  response  or  miss* 
ing 

Two  items  on  instruaional  methods  emphasizing 
student  pamapation  Alpha  internal  consistencv 
reliability  ■  .43  '*Ho^  often  has  each  of  the 
following  been  used  in  the  courses  you  are  taking 
this  year?" 

1.  Participations  in  student-centered 
discussions 

2.  Having  individualized  instruction  in  small 
groups  or  one*tOK>ne  with  a  teacher 

Coded:  3  ■  frequently.  2  ■  fairly  often.  1  « 
seldom  or  never,  blank  ■  no  response  or  miss* 
ing.  _ 
Four  items  indicating --frequency  of  course* 
related  activities.  Alpha  internal  consistencv 
reliability  *  .46. 

"How  often  has  each  of  the  following  been  used 
in  the  courses  you  are  taking  this  year?" 

1.  Working  on  a  project  or  in  a  laborator> 

2.  Writing  essays,  themes,  poetry,  stories 

3.  Going  on  field  tnps 

4.  Library  or  media  center  assignments 
Coded:  3  ■  frequently.  2  ■  fairly  often.  1  ■ 
seldom  or  never,  blank  ■  no  response  or  miss- 
ing. 

Seven  items  indicating  mathematics  course  taken 
or  completed;  summed  to  indicate  number  of 
years  mathematics  was  studied.  "Which  of  the 
following  mathematics  courses  have  you 
studied?" 

1.  General,  business,  or  consumer  mathe- 
matics (38.3%  studies  one  year) 

2.  Pre-algebra  (36.0%) 

3.  First  year  algebra  (67.3%) 

4.  Geometry  (43.3%) 

5.  Second  year  algebra  (28.7%) 

6.  Tngonomnry  (6.7%) 

7.  Pre<alculus/calculus  (2.2%) 

Coded:  0  ■  am  studied.  .25  -  studied  less  than 
one  half  of  school  year.  .5  studied  one  half  of 
school  year,  I  ■  studied  about  I  school  year, 
blank  ■  no  response  or  miuing. 
Indicates  highest  level  mathematics  course  taken 
for  at  least  one  half  of  school  year.  Coded  in 
order  of  course  difOculty: 

1  ■  General,  business,  or  consumer 

maihematia  (10.9%) 

2  -  Pre*algebra  (7.2%) 

3  -  First  year  algebra  (17.3%) 

4  ■  Gcomcry  (14.0%) 

5  ■  Second  year  algebra  (23.8%) 

6  ■  Trigonometry  (9.7%) 

7  ■  Pre<alculus/calculus  (4.0%) 
Blank  •  no  response  or  missing  (13.1%) 

Amoum  of  time  spent  doing  homework  last 
night.  Coded: 

3  ■  more  than  two  houn  (8%) 

2  a  between  one  and  two  hours  (18%) 

1  ■  less  than  one  hour  (20%) 

0  ■  did  not  do  homework  or  no  homework 

assigned  (40%) 
Blank  ■  no  response  or  missing  (14%) 
Amoum  of  time  spent  watching  TV  last  night 

8  ■  six  or  more  hours  (4.0%) 
7  ■  five  houn  (3.6%) 

6  ■  four  hours  {9M\ 
5  ■  three  hours  (11^%) 

4  ■  tti^  hours  (14.9%) 

3  ■  one  hour  (8.0%) 

2  -  leu  than  one  hour  (15.7%) 

1  -  none  (18.6%) 

Blank  >  no  response  or  missing  (14.9%) 


BEST  COPY  AVAILABLE 
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Vrftun  [h$crtpttofi$  tmr  Numt>f$  of  Ifmt,  H%tt%biim9,  tnn  Um^rinm  Smtfst{c$ 
  «S3 


Vocabulary  i 
Vocabulary  2 
Raadlng 
Mathamatica  1 
Mathamatica  2 


Aga 

Motivation 
Aaplratlon 
Woit  orlantatlon 

Adiuatmant 
Probfama 
Control  locus 
Motivation 

LawtrouWa 

Quality  of  Inatructlon 
Quality 


Daacnptiona  or  Sampia  Contant  of  itama;  Numbar 

F^fcantaoaa  for  Cataoodcal  ttama  of  Itama  Ratiabllity  Maan 


Standard 
Dtviation 


Muitipl»<holc»  taat 
Muttlpiachoica  taat 
Multlpia<holca  taat 
Multipia<hoica  taat 
Multipla-cholca  taat 


Occupational  goala  aga  30 
(HSB  tcorad  compoaita) 
Salf-aattafactlon 

Oiactpllna  proMama,  cuttincL  m 
auapanalon 

(HSB  aeorad  compoaita) 
Itama  on  Englltti  and  mathamatica  intaraat 
and  uf  afulnasa.  intaraat  and  hard  work 
Sartoua  troubia:  Yaa«3.9% 

ftetlnga  of  quality  of  Inatructlon  auch  aa 
good  taachtng.  aeadamle  amphaala.  achool 
raputatlon.  taaehar  Intaraat  m  ttudanta.  and 
Instructional  quailtlaa 


Quantity  of  Inatructlon 
Quantity 


School  Envlfonmant 
FaciHtiaa 
DIacipllna 

ExtracuiTtculsr 
sctMtlas 
Pasf  Envlronmant 


Homa  Environmam 
Parant  intaraat 

Homa  fseimias 

Mothar  woftt 


Aga  first  wotltad 
Womad  last  wask 
Hours  cunsntly 


Acadamic  coursaa  complatad  In  English, 
mathamatica.  Franch,  Garmsn.  Spsmsh 
history  snd  sclanca 

Atllnga  of  achool  building  Md  llbrwy 
Ratings  of  sffacthranass  Md  f mass 
of  school 

Studwtt  particlbBllon  In  school  sports, 
dubs,  bond,  snd  dsbsis 

Qradas  of  frlsnds.  thsir  school  imarast 
In  dsaaaa  and  eotlaga,  and  ragulv  achool 
attandsnea 


Fmmal  monitoring  and  tmarsst  in  school. 

wotK  ami  csrosr  pisns 

Pisea  to  atudy,  dally  nawapapar, 

anclyclopadls,  and  alacirtc  dtshwsshar 

Mother  working  bafora  and  during  aiaman- 

tsry  snd  high  school 

Hourn  psr  waak  spam  on  homawork 

For  pay 

In  hours 

In  hours 


Hours  wofksd  par 
waak  during  pr«vl> 
oua  achool  yasr 
Socloaconomie 
ststus  (8ES) 
Madia  Expoaura 

talavlalon 
Mlacallanaoua 
Handicaps 


Physlcsily 

Ysa 

■ 

11.8 

unsdractlva 

Mala 

Yaa 

w 

47.9 

Whita 

Yaa 

■ 

753 

Spanlah 

Yaa 

■ 

11^ 

Aalan 

Yaa 

■ 

1J 

Black 

Yaa 

■ 

14.0 

Altamatlva 

Yaa 

■ 

22 
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Table  1 

Variable  Description  ^  •'-^'^ 


Variable 

Mathematics  Achievement 


Male 

Socioeconomic  Status 
Scientific  Background 
Father's  Occupation 


Mother's  BnployMnt 


Highest  Mathematics 
Course  Taken 


ERIC 


Operational  Definition >  Scoring,  and  Sairple  Itens 

70  itens  assessing  student  mathematics  in  both  content 
(mathematics  subject  matter)  and  cognitive-process 
levels  (e.g. 9  particular  skills,  abilities,  and 
knowledge,  etc.) 

Range  of  fnternal-consistency  reliability 

(Kuder -Richardson  20)  among  12  countries  is. 73  to  .93, 

where  the  United  States  is  .84. 

•The  result  of  an  operation  on  the  numbers  9  and  18 
is  27.    In  this  operation,  the  number  27  is 

(a)  product;  (b)  sum;  (c)  quotient;  (d)  difference, 
(e)  average. *    *Four  persons  %rhose  names  begin  with 
different  letters  are  placed  in  a  row,  side  by  side. 
What  is  the  probability  that  they  will  be  placed  in 
alphabetical  order  from  left  to  right?    (a)  1/120; 

(b)  1/24  (correct);  (c)  1/12;  (d)  1/6;  (e)  1/4." 

Coded:    1-male,  0-female 

Highest  amount  of  either  parent's  education;  code  is 
indicated  by  the  number  of  completed  years. 


To  indicate  father's  occupation: 
0«-nonscientific 


l^scientif ic. 


Coded;    1-bigher  professional  and  technical  occupations 

2-  farm  proprietors  and  farm  laborers 

3-  subpro£essional  technical,  small  worker* 
proprietor  (non-farm),  clerical,  and  sales 

4-  manual  workers  (non*farm) 

•Is  your  mother  presently  working?* 

Coded;    0-not  working,  1-part  time,  2-full  time 

''Indicate  the  highest  level  of  mathematics 
courses  that  you  have  taken  recently; 
(coded;)    1-arlthmetic  or  general  mathematics 

2«*algebra 

3*geometry 

4«*trigonometry 

5-advanced  mathetics  (calculus,  etc.)" 
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Table  1  (page  2  of  2) 


variable 

Number  of  Students 
Math  Class 


Operational  Definition^  Scoring,  and  Sample  Items 

in         "Indicate  the  approximate  number  of  students 
in  your  present  or  most  recent  mathematics 
course:     (coded: ) 

1-  under  10  5-25  through  29 

2-  10  through  14         6-30  through  34 

3-  15  through  19         7-35  through  39 

4-  20  through  24         8-40  or  more" 


Periods  of  Math 
per  Week 


Hours  of  Homework 


Extra  Mathematics 
Activities 


Interest  in  Mathematics 


Attitude  Toward 


"In  your  mathematics  class,  how  many  periods 
do  you  have  each  week?    (coded} : 

1-  1  or  2  5-9  or  10 

2-  3  or  4  6-11  or  12 

3-  5  or  6  7-13  or  more" 

4-  7  or  8 

"Indicate  the  amount  of  hours  that  students 
usually  devote  to  homework  each  week." 

"Have  you  been  a  member  of  any  mathematics 
club,  or  attended  special  lectures  or  courses 
on  mathematics?    (coded:)    1-yes,  0-rio" 

Ten  items  are  included  to  measure  the  level 
of  interest  in  mathematics;  e.g., 
"V7ishes  to  take  additional  math  couses  (coded:) 
1-yes,  0-no* 

"Which  two  school  subjects  have  you  liked 
most?    (coded:)    1-mathematics,  0-others 

Eleven  items  form  a  scale  to  ascertain  tne 
student's  disposition  toward  school  life,  e.g., 
"I  find  school  interesting  and  challenging, 
(coded:)    2-agree,  0-disagree" 
"I  am  bored  most  of  the  time  in  school* 
(coded:)     2-disagrec,  0-agree" 


) 
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Toward  Achieving  Educ&tional  Excellence 
for  All  Students 

Margaret  C.  Wang 

Learning  Research  and  Development  Center 
University  of  Pittsburgh 


Working  to  provide  school  learning  environments  that  lead  to  educational  success 
for  all  students  has  been  a  staple  of  reform  efforts  throughout  the  history  of  public 
education  In  the  United  States.  In  recent  years,  this  goal  has  been  conjoined  with  that 
of  Improving  schools'  capabilities  to  effectively  serve  Increasingly  diverse  student 
populations,  particularly  students  from '  economically,  culturally,  and  language 
disadvantaged  backgrounds  and  other  academlcally-at-risk  students.  Public,  Judicial, 
and  legislative  movements  calling  attention  to  both  equal  access  and  equal  chances  to 
achieve  schooling  success  have  been  a  key  factor  in  the  intersecting  of  these  two  goals. 
The  enactment  of  the  Education  for  All  Handicapped  Children  Act  of  1975  (PL  04-142) 
is  a  prime  example  of  such  efforts. 

Significant  progress  has  been  made,  especially  during  the  past  decade.  In  providing 
equal  access  to  free  and  appropriate  schooling  for  .all  students.  Now  that  virtually  all 
school-aged  children  and  young  adults  attend  school  (Pllsko,  1084),  ensuring  equal 
opportunities  for  schooling  success  through  quality  education  has  become  a  national 
priority  (e.g..  National  Coalition  of  Advocates  for  Students,  1085;  National  Commission 
on  Excellence  in  Education,  1083;  Twentieth  Century  Fund,  1083;  U.  S.  House  of 
Representatives,  1983).  The  current  push  for  educational  excellence  recognizes  that  the 
critical  goal  of  merging  human  resources  &nd  talents  with  technological  and  economic 
growth  cannot  be  achieved  without  a  concerted  effort  to  curtail  the  rising  number  of 
students  with  poor  prognoses  for  academic  success  while  also  increasing  educational 
efficacy  and  productivity  for  all  students. 

Thus,  a  number  of  convergent  realities  challenge  us  to  bring  about  Improved 
education  for  all  students.  These  include  public  sentiment,  legislative  and  regulatory 
developments,  the  need  to  invest  in  human  capital,  technological  Innovations,  and 
demographic  changes.  Greater-than-usual  educational  support  b  likely  to  be  required 
for  accommodating  the  expanding  literacy  requirements  that  accompany  rapid 
technological  growth  In  our  advancing  society  as  well  as  the  anticipated  continuing 
trend  of  increasing  proportions  of  the  school^aged  population  ftom  culturally, 
economically,  and  language  disadvantaged  backgrounds.  Ir  responding  to  this 
challenge,  school  Improvement  efforts  can  draw  from  parallel  de .  elopments  in  research 
on  learning  and  effective  schooling,  advances  In  educational  technology,  and  the 
development  and  Implementation  of  innovative  programs. 

In  this  context,  this  paper  has  two  main  purposes.  The  first  is  to  discuss  the 
Implications  of  findings  from*  the  past  decade  of  educational  reform  aimed  at  Improving 
the  quality  of  schooling  -  particularly  for  special  needs  students.  (Special  needs 
students  are  defined  here  as  students  who  are  acadenilcally-at.risk  and/or  who  receive 
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special  education  or  compensatory  education  services  such  as  Chapter  I,  bilingual  ^ 

education,  or  migrant  education.)    The  second  purpose  of  the  paper  Is  to  identify 

information  needs  and  formulate  recommendations  to  the  National  Center  for 

Education  Statistics  (NCES)  regarding  specific  ways  of  broadening  the  current  data 

base  to  enhance  its  relevance  for  descrlptlou,  analysis,  and  Improvement  of  the 

conditions  and  quality  of  schooling  for  all  students. 

RECENT  DE^TLOPMENTS  AND  CURRENT 

SCHOOL  IMPROVEMENT  EFFORTS 

The  State  of  Practice 

In  response  to  the  call  for  both  equal  access  to  schooling  and  educational  success, 
the  past  20  years  have  witnessed  a  proliferation  of  legislation  and  federally-supported 
"speclaP  or  "compensatory"  remedial  education  programs.  Actual  steps  to  Improve 
the  educational  attainment  of  special  needs  students  generally  have  focused  on  creating 
separate  programs  that  have  been  implemented,  for  the  most  part.  In  settings 
segregated  from  regular  education  students  and  classes.  The  growth  of  this  segregated 
approach  was  especially  rapid  In  the  1970's  when,  for  example,  students  with  learning 
problems  (e.g.,  low  achievement,  disciplinary  problems)  were  treated  as  "special"  and 
relegated  to  separate  programs  Implemented  primarily  by  specialists.  This  approach, 
albeit  well-intentioned,  neglected  to  recognize  the  larger  problem  -  that  regular  school 
environments  had  failed  to  accommodate  the  educational  needs  of  a  large  number  of 
students.  On  the  one  hand,  it  can  be  argued  that  special  programs  are  positive  steps 
reflecting  a  commitment  to  provide  effective  Instruction  for  ail  children.  However,  the 
"set-aside"  strategy  on  which  the  programs  are  based  Is  driven  by  the  fallacy  that  poor 
school  adjustment  uxd  performance  are  attributable  solely  to  characteristics  of  the  child 
rather  than  to  the  quality  of  the  school  learning  environment. 

The  problems  faced  by  schools  la  their  efforts  to  adequately  provide  for  special 
needs  students  are  derived  from  a  variety  of  sources.  These  range  from  changes  In 
national  educational  priorities  to  the  increased  focus  on  procedural  rather  than 
programmatic  Issues.  Included  among  the  specific  road  blocks  to  equal  access  and 
educational  excellence  for  special  needs  students  are  the  redeployment  of  critical 
resources  (human  and  fiscal)  from  the  provision  of  education  to  the  administration  of  an 
inordinate  number  of  separately  funded  and  delivered  programs;  the  proliferation  of 
classifications  for  students  with  special  learning  needs,  combined  with  the  growing  use 
of  nonlnstnictlon-related  criteria  to  label  and  classify  greater  and  greater  numbers  of 
students  In  mildly  handicapped  categories  such  as  learning  disabled  (LD):  a  downshift  in 
public  and  financial  support  for  school  programs  in  both  regular  and  special  education; 
inadequate  personnel  preparation  programs  for  Instructional  staff  -  Including  regular 
and  special  educators  -  who  are  expected  to  develop  and  implement  effective 
instruction  for  students  In  the  many  special  and  compensatory  education  categories;  and 
an  overall  laclc  of  coordination  between  educational  experiences  In  special  and  regular 
education  settings. 
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Observations  in  a  variety  of  school  settings  have  suggested  that  reliance  upon 
separate  school  improvement  programs  often  leads  to  piecemeal  remediation  In 
segregated  environments.  While  "pull-out"  programs  may  be  helpful  for  certain 
students  (e.g.,  severely  disabled  students),  such  programs  are  more  likely  to  have 
negative  results,  Including  discontinuities  and  interruption  In  the  InstnictlonaMeaming 
process  for  teachers  and  students,  loss  of  control  by  school  district  leadership  over 
specialized  programs,  and  the  fostering  of  narrow  categorical  attitudes  and  Instructional 
programming  (cf.  Heller,  Holtzman,  &  Messick,  1982;  Reynolds  &  Wang,  1983).  As 
further  evidence  of  the  Inadequacy  and  arbitrariness  of  the  segregated  approach  to 
providing  Instruction  for  special  needs  students,  enrollments  In  the  least  well-defined 
categories  such  as  LD  are  climbing  beyond  the  tolerance  of  budget  makers;  the  courts 
are  taking  away  many  of  the  "special"  classification  procedures  (as  in  Larry  P.  v.  Riles, 
1972);  scientists  tell  us  that  most  of  the  diagnoses  performed  In  special  education 
essentially  are  unrelated  to  treatments  (Reschly,  in  press;  Ysseldyke,  Aigozzine,  A  Bpps, 
1983);  and  the  monitoring  of  compliance  with  special  education  legal  requirements  tends 
to  be  more  procedural  than  substantive.  In  recent  years,  the  problems  associated  with 
the  many  separate  programs  have  resulted  in  the  emergence  of  new  approaches  to  more 
effectively  meeting  the  diverse  needs  of  most,  if  not  all,  students  In  regular  school 
environments. 

The  Setting  for  Change 

Finding  feasible  and  effective  ways  to  restnicture  special  and  compensatory 
education  programs  and  delivery  systems  clearly  is  a  pressing  current  need.  It  is 
Important  to  keep  in  mind,  however,  that  this  restructuring  process  must  take  place  In 
the  context  of  the  entire  educational  enterprise.  Special  and  compensatory  education 
programs  often  are  expected  to  accomplish  what  otherwise  would  be  left  undone,  or 
done  poorly,  by  regular  education.  If  headway  is  to  be  made  In  the  effective  academic 
and  social  integration  of  special  needs  students  in  regular  classes,  regular  education  staff 
and  specialized  professional  personnel  at  the  federal*  state,  and  local  levels  must  work 
together  to  negotiate  the  removal  of  many  of  the  present  barriers.  We  need  to  achieve 
a  healthy  balance  between  the  current  preoccupation  with  classification  of  students  for 
educational  placement,  efforts  to  Identify  specific  Instructional  needs,  and  the 
Implementation  and  refinement  of  available  instructional  solutions. 

AdTsnees  In  Research  and 
Innovative  Program  Deirelopmeat 

The  history  of  educational  reform  generally  has  been  characterized  by  patterns  of 
parallel  developments  In  psychological  theory  of  learning,  technical  advances  in 
Instructional  practices,  and  soclbeconomlc  and  political  mandates  of  the  time.  Likewbe, 
the  beginning  phase  of  the  current  new  wave  of  devetopments  b  marked  by  significant 
progress  in  research  on  learning  and  effective  teaching*  an  Intense  motivation  to 
improve  schools'  capabilities  for  effectively  responding  to  student  diversity.  Innovative 
program  development  and  the  implementation  of  school  improvement  efforts,  and  the 
sociopolitical  mandate  to  maximize  the  chances  of  schooling  success  for  all  students. 

A  number  of  alternative  Interventions  have  been  developed  and  tested  for 
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integrating  special  needs  students  in  regular  classes.  Recent  research  literature  as  well 
as  the  reports  of  several  prominent  groups  (e.g.,  Cantalician  Foundation,  1083;  Heller  et 
al.,  1982;  Mayor's  Commission  on  Special  Education.  1985)  point  to  the  potential  of 
these  tnterventioos.  Some  of  the  specific  recommendations  that  have  emanated  from 
recent  reports  are  the  full  academic  and  social  integration  of  special  needs  students 
(handicapped  students  and  other  children  at  the  margin)  in  regular  classes  and  schools; 
the  provision  of  appropriate  educational  experiences  based  on  learning  needs  rather 
than  on  rigid  classifications,  labels,  and  placements;  and  the  restructuring  of  regular 
education  to  more  effectively  accommodate  all  individual  students,  regular  and  special 
needs  students  alike.  Researchers,  policymakers,  and  practitioners  all  have  become 
lobbyists  for  the  delivery  of  compensatory  and  special  education  services  In  regular 
classes;  in  doing  so,  they  have  espoused  the  educational  vision  of  ensuring  quality 
schooling  services  for  the  Increasingly  diverse  student  populations  our  nation's  schools 
are  challenged  to  serve  (Heller  et  aL,  1982;  National  Coalition  of  Advocates  for 
Students,  198S;  U.S.  House  of  Representatives,  1983). 

Implementation  and  Fiscal  Barriers 

In  spite  of  recent  research  findings  and  experience  vrith  innovative  program 
development  and  implementation  that  point  to  the  feasibility  and  efficacy  of  integrating 
special  needs  students  in  regular  classes,  special  education  programs  and  a  wide  variety 
of  compensatory  education  programs  continue  to  operate  as  separate  systems  (often 
more  accurately  characterized  as  "^nonsystems").  In  many  cases,  overlapping  separate 
services  are  provided  for  the  same  students.  Implementation  of  an  integrated  approach 
to  improving  educational  conditions  in  thb  area  will  require  fundamental  programmatic, 
organizational,  and  funding  policy  reforms.  A  first  step  In  thb  direction  vrould  be  the 
establishment  of  an  open,  experimental  period,  during  which  regular,  special,  and 
compensatory  education  could  be  combined  to  encourage  innovative  development  aimed 
at  providing  improved  and  integrated  educational  services  along  a  full  continuum  - 
including  supplementary  aids  and  pre-referral  services  in  regular  classes.  In  local 
schools,  leadership  should  be  encouraged  for  experimentation  and  for  evaluating  the 
effectiveness  of  a  variety  of  educational  approaches  In  solving  the  widespread  persistent 
problem  of  how  to  achieve  more  productive  learning  for  all  students.  Attention  must  be 
directed  to  putting  Into  operation  the  most  promising  Ideas  and  practices  and,  at  the 
same  time,  making  the  necessary  policy  changes. 

Information  Needs 

If  the  implementation  of  an  open  system  for  educational  restructuring  is  to  occur 
with  a  high  level  of  precision  and  credibility,  efforts  during  the  next  decade  must 
include  the  development  of  a  data. base,  on  a  variety  of  alternative  programs  of 
educational  excellence  for  all  students.  This  Improvement  orientation  dictates  gathering 
the  kinds  of  information  that  further  understanding  and  specification  of  what 
constitutes  effectiveness  (Indicators  of  efficacy);  the  conditions  that  Influence 
effectiveness  (e.g.,  program  features  and  classroom  environments);  and  the  features  of 
cost-effective,  alternative  programs  a.  1  practices,  particularly  programs  and  practices 
directed  at  students  with  poor  prognoses  for  educational  success. 
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An  overriding  design  concern  in  the  task  of  gathering  information  on  the 
conditions  and  impact  of  educational  programs  is  the  extent  to  which  the  resulting  data 
base  will  be  useful  to  researchers,  educators,  policymakers,  and  parents  in  their  choice 
of  avenues  for  Improving  schools'  capabilities  to  become  Increasingly  more  effective  in 
maximizing  the  chances  of  schooling  success  for  all  students.  In  this  context, 
information-gathering  agencies  like  NCES  can  play  a  critical  leadership  role  in  turning 
around  the  current  preoccupation  with  collecting  data  for  trend  analysis  and  forecasting 
purposes  only.  The  focus  more  appropriately  should  be  shifted  to  a  data-based 
approach  whereby  information  is  used  to  guide  the  formulation  of  visionary  educational 
improvement  goals  and  agendas  for  supporting  futures  research. 

A  major  limitation  of  the  current  NCES  data  oase  Is  its  lack  of  utility  for  meeting 
the  information  needs  of  school  improvement  efforts.  As  noted  by  Ravitch  (1983),  it  is 
designed  almost  exclusively  to  gather  data  on  the  socioeconomics,  rather  than  the 
quality,  of  education.  Like  the  extant  data  sets  being  compiled  by  other  federal,  state, 
and  local  educational  agencies,  the  NCES  data  base  can  be  characterized  as 
predominantly  '^status'*  in  nature.  It  consists  mainly  of  Information  such  as  enrollment 
trends,  cost  per  pupil,  student  achievement  as  measured  by  standardized  tests,  and 
teacher-student  ratios  and  other  status  information  derived  primarily  from  easily 
accessible  quantifiable  data.  Status-oriented  information  is  admittedly  useful  for 
conducting  trend  analysis  aimed  at  describing  the  nation*s  educational  enterprise  from 
the  socioeconomic  and/or  political  perspectives.  -  However,  these  data  provide  little 
Information  for  informed  decision  making  on  the  quality  of  education  -  that  is,  the 
crucial  conditions  and  Instructional  practices  for  creating  school  learning  environments 
that  facilitate  educational  effectiveness. 

RECOMMENDATIONS  FOR  BROADENING 

THE  NCES  DATA  BASE 

The  discussion  in  this  section  centers  on  three  topics.  They  are  (a)  the  rationale 
and  research  bases  for  broadening  the  NCES  data  base  to  include  Information  on 
program  features,  implementation  conditions,  and  a  wide  array  of  program  efficacy 
indicators;  (b)  the  specific  types  of  data  that  should  be  included;  and  (c)  the 
implications  for  using  the  NCES  data  base  to  formulate,  monitor,  and  evaluate  school 
improvement  efforts. 

Rationale  and  ReMareh  Basea 

In  making  recommendations  to  NCES,  t^o  major  areas  of  concern  are  addressed. 
The  first  is  the  need  for  information  on  the  learning  environment  (where,  how,  and  the 
conditions  under  which  Instruction  and  learning  take  place).  The  second  area  of 
concern  Is  the  need  for  information  on  a  variety  of  outcomes  of  effective  schooling, 
particularly  wbat  students  lean  beyond  the  basic  skills  as  measured  by  achievement 
tests  (e.g.,  the  quality  of  students*  functioning  in  and  outside  of  the  school  learning 
environment,  students'  ability  to  learn  on  their  own  and  from  others,  students' 
perceptions  of  self-competence).  The  rationale  and  research  bases  for  addressing  these 
concerns  are  dteeussed  below. 
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Features  and  the  Efflc&cy 

of  School  Learning  Bnvironmenta 
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The  design  and  implementation  of  school  learning  eavirorLinents  that  enable  each 
student  to  achieve  desired  educational  outcomes  are  at  the  core  of  effective  schooling. 
The  basic  premise  here  Is  that,  insofar  as  learning  is  a  function  of  a  student's  response 
to  the  school  learning  environment,  instruction  is  the  iDt;entio):aI  manipulation  of  the 
learning  environment  to  facilitate  appropriate  student  responses.  A  major  complicating 
factor  in  this  purposeful  design  and  use  of  learning  environments  is  the  diverse 
requirements  of  individual  students  for  achieving  given  outcomes.  Thus,  the  task  of 
improving  the  quality  of  schooling  is  twofold.  It  involves  increasing  schools'  capabilities 
to  effectively  accommodate  the  unique  learning  needs  of  individual  students,  while  also 
providing  instructional  interventions  that  enhance  each  student's  ability  to  respond 
effectively  to  schooling  and  thereby  to  eventually  attain  intended  outcomes. 
Accomplishing  this  duai-natured  task  Is  a  continuing  challenge  for  educators. 

Responses  to  this  challenge  have  included  a  variety  of  research  and  development 
efforts  with  significant  Implications  for  the  design  and  implementation  of  educational 
practices  that  enable  students,  including  students  with  special  learning  needs,  to 
maximize  their  chances  for  learning  success.  In  fact,  the  development  of  practicable 
educational  interventions  that  provide  greater-than-usual  educational  support  to 
accommodate  the  learning  needs  of  individual  students  has  been  the  hallmark  of 
effective  schooling  (cf.  Brandt,  1985).  Four  recently  completed  research  Integration 
studies  are  discussed  below  to  provide  an  overview  of  these  developments.  All  four 
studies  were  designed  to  Identify  critical  features  of  widely-Implemented  educational 
interventions  or  approaches,  as  well  as  investigate  the  relationship  of  the  program 
features  to  a  variety  of  desired  student  learning  processes  and  outcomes.  When 
considered  collectively,  findings  from  the  four  studies  represent  a  comprehensive 
analysis  of  the  state  of  the  art  and  the  state  of  practice  In  topics  related  to  schooling 
and  student  diversity.  For  the  specific  purposes  of  this  paper,  they  serve  to  illustrate  In 
particular  the  research  base  for  the  kinds  of  Information  on  the  features  and  efficacy  of 
school  learning  environments  that  should  be  included  In  the  NCES  data  base. 

The  first  study  Involved  the  compilation  and  suxmnary  of  findings  from  over  2,500 
studies  of  educational  effects  on  learning  (Walberg,  1934).  It  was  conducted  to  identify 
major  causal  influences  on  educational  productivity.  The  second  and  third  studies  were 
designed  to  identity  characteristic  features  of  programs  that  provide  for  student 
differences.  One  of  these  studies  was  a  quantitative  sjmthesis  of  studies  of  features  and 
outcomes  of  instructional  programs  aimed  at  adapting  to  student  differences  (Waxman, 
Wang,  Andersout  &  Waiberg*  1985).  The  other  was  a  quantitative  synthesis  that 
focused  on  the  features  and  efficacy  of  mainstreaming,  or  the  Integration  of 
handicapped  students  in  regular  classes  (Wang,  Birch,  Anderson,  St  Reynolds,  1985). 
The  final  study  was  a  large-scale,  classroom  observation  study  of  program  features, 
classroom  processes,  and  outcomes  In  exemplary  classes  of  eight  instructional  models 
(Wang  &  Walberg,  in  press). . 

Findings  from  the  four  studies  are  summarized  under  two  headings:  productivity 
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factors  in  learning,  and  characte'-lstlc  features  of  learning 
individual  differences. 


nents  that  provide  for 


Productiv.ty  Factors  In  Learning 

Nine  interrelated  factors  have  been  found  to  be  consistently  associated  with 
student  learning  outcomes  (Walberg,  1984).  These  factors  fall  into  thrte  categories: 
student  characteristics  (aptitude);  instruction;  and  environment.  The  three  factors  in 
the  student  characteristics  category  are  ability  or  prior  achievement,  as  measured  by 
standardi'^ed  tests;  development,  as  indexed  by  chronological  age  or  state  of  maturation; 
and  motivation  or  self-concept,  as  indicated  by  personality  tests  or  students'  willingness 
to  persevere  intensively  in  learning  tasks.  The  instruction  category  consists  of  two 
factors:  the  amount  of  time  that  students  are  engaged  In  learning;  and  the  quality  of 
instructional  experiences,  including  psychological  and  curriculum  aspects.  The  four 
factors  In  the  environment  category  are  the  educational  and  psychological  climates  of 
the  home,  the  classroom  social  group,  the  peer  group  outside  of  school,  and  the  use  of 
out-of-school  time.  ^ 

Oveiali,  the  major  causal  influences  on  student  learning  flow  from  student 
characteristics,  instruction,  and  the  environment  to  learning.  Furthermore,  the  three 
categories  of  factors  also  Influence  each  other  and.  In  turn,  they  influence  how  much 
students  learn.  For  example,  each  of  tae  five  factors  In  the  student  characteristics  and 
Instruction  categories  appears  necessary  for  learning  In  schools;  without  at  least  a  small 
amount  of  positive  Influence  of  each  factor,  a  student  leams  little,  LarRe  amounts  of 
instruction  and  high  degrees  of  ability  may  not  count  for  much  if  '  dent  Is  not 
motivated  or  if  Instruction  la  onsuitable.  Thus,  findings  from  Walberg's  research 
synthesis  not  only  provide  empirical  support  for  examining  the  conditions  of  schooling 
and  their  impact  from  D^  itiple  perspectives,  but  the  findings  also  suggest  that  such 
examination  requires  a  host  of  information  on  both  the  quality  of  schooling  and  a  wide 
range  of  outcomes.  . 

Characteristic  Features  of  Learning  Environments 
Thgt  Provide  for  Student  Differences 

The  past  decade  of  Instructional  experimentation  and  innovative  program 
development  and  implementation  aimed  at  improving  schools*  capabilities  to  effectively 
acconmiodate  students  with  diverse  characteristics  and  leaiiilng  needs  hjfl  resulted  In  a 
substantial  research  base.  A  rather  consistent  list  of  salient  features  of  programs  aimed 
at  acconmiodating  Individual  differences  can  be  derived  from  the  extant  research  base. 
Findings  from  two  quantitative  sjmtheses  of  empirical  studies  reported  in  the  literature 
during  the  past  decade  prcvlde  a  srjnmary  analysis  of  this  research.  The  first  synthesis 
included  38  empirical  studies  of  adapUve  instruction  that  were  publishea  'ji  the  period 
from  1072  through  1982  (Waxman  et  al.,  1985);  the  data  ba^e  consbted  of  a  combined 
sample  of  approximately  7,200  students.  The  second  synthesis  was  designed  to 
ch^xacterize  the  program  de^ilgn  features  and  effects  of  Instructional  Interventions  for 
malnstreaming  handicapped  students  in  regular  classes  (Wang,  Birch,  Anderson,  Sc 
Reynolds,  1985).  This  study  was  based  on  statistical  data  from  29  empirical  studies  of 
malnstreaming  effects. 
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A  common  core  of  program  features  is  distinguisl  ole  across  the  studies  of 
adaptive  instruction  reviewed  by  Waxman  et  al.  (1985).  These  features  include  (a) 
instruction  based  on  the  assessed  capabilities  of  each  student;  (b)  materials  and 
procedures  that  permit  each  student  to  make  progress  in  mastering  instructional 
content  at  a  pace  suited  to  his  or  her  abilities  and  interest;  (c)  periodic  evaluations  to 
inform  each  student  of  his  or  *}er  progress  toward  skills  mutery;  (d)  students' 
assumption  of  responsibilit:''  for  diagnosing  their  present  needs  and  abilities,  planning 
individual  learning  activities,  pursuing  the  planned  activities,  and  evaluating  mastery; 
(e)  alternative  activities  ^nd  materials  for  aiding  each  student's  acquisition  of  essential 
academic  skiUs;  (f)  student  choice  In  selecting  educational  goals,  outcomes,  and 
activities;  and  (g)  students  assisting  one  another  in  pursuing  individual  goals  and 
cooperating  to  achieve  group  goals.  Similar  features  also  were  found  to  be  prominent  In 
the  data  from  studies  included  In  the  quantitative  synthesis  of  malnstreamlng  program 
features  and  effects  (Wang,  Birch,  Anderson,  &  Reynolds,  1985).  The  design  features 
cited  most  frequently  among  the  malnstreamlng  programs  are  continuous  assessment, 
use  of  alternative  routes  and  a  variety  of  materials,  individualized  progress  plans, 
student  self-management,  peer  assistance,  and  instructional  teaming. 

The  features  of  adaptive  instruction  found  in  the  two  quantitative  syntheses  of 
extant  empirical  studies  discussed  above  also  were  noted  in  ihe  results  from  the 
observation  study  of  design  features,  processes,  and  outcomes  of  eight  widely- used 
contemporary  educational  programs  (Wang  &  Walberg,  in  press).  Many  of  the 
programs  included  in  the  Wang  and  Walberg  study  are  identified  by  descriptors  such  as 
individualized  Instruction^  mastery  learning,  and  adaptive  education,  and  they 
incorporate  program  features  such  as  cooperative  learning,  differentiated  staffing,  and 
computer-assisted  management  and  Instruction.  A  number  of  the  programs  are 
considered  to  be  prototypes,  and  several  have  been  widely  adopted  by  schools  (Jeter, 
1980;  Rhine,  1981;  Talmage,  1975).  The  eight  programs  Included  in  the  study  are  the 
Adaptive  Learning  Environments  Model  (Wang,  Gennari,  &  Waxman,  1985);  the  Bank 
Street  Model  (Gllkeson,  Smlthberg,  Bo'^man,  &  Rhine,  1981);  the  Behavior  Analysis 
Model  (Ramp  &  Rhine,  1981);  the  Direct  Instruction  Model  (Becker,  Engelmann, 
Camine,  &  Rhine,  1981);  Individually  Guided  Education  (Klausmeler,  1972);  the 
Mastery  Learning  approacL  (Bloom,  1968);  Team-Assisted  Individualization  (Slavln, 
1983);  and  iht  Utah  System  Approach  to  Individualized  Learning  (U-SAJL)  (Jeter, 
1980).  Classrooms  that  represent  exemplary  implementations  ot  these  programs  were 
identified  by  the  program  developtrs  and  served  as  the  sample  pool  for  the  study. 

A  major  objective  of  this  observation  study  was  to  identify  (a)  the  specific 
features  of  adaptive  instruction  that  are  integrated  into  working  programs  with  the 
design  objective  of  making  Instructional  provisions  for  individual  differences,  and  (b) 
the  kinds  of  classroom  processes  and  outcomes  typically  associated  with  these  programs. 
Data  from  65  second-,  third-,  and  fourth-grade  classrooms  provided  information  on 
contextual  characteristics  of  the  programs  ana  the  implementation  sites,  critical  features 
of  adaptive  instn]ct!oi\  as  they  were  Implemented,  and  the  nature  and  patterns  of 
classroom  processes. 

Analysis  of  the  design  features  of  the  eight  programs  was  based  op  two  data 


sources:    program  design  documents  on  each  program,  and  data  from  classroom 
(  observations  of  the  sample  program  classrooms.  Results  from  analysis  of  the  program 

design  documents  suggest  that,  although  the  eight  programs  are  derived  from  different 
theoretical  bases  and  use  different  Instructional  strategies,  there  are  striking  similarities 
in  program  features  across  their  designs.  For  example,  a  dlagnostic*prescrlptlve 
component  Is  a  core  feature  of  ail  the  programs  included  In  the  study.  Each  program 
emphasizes  the  importance  of  prescribing  tasks  that  are  appropriate  for  the  learning 
needs  of  individual  students.  Similarly,  each  of  the  programs  uses  assessment 
procedures  to  determine  whether  students  have  achieved  objectives  and  are  ready  to 
move  on,  or  whether  they  need  further  instruction  or  practice.  Ali  the  programs  stress 
the  need  to  maintain  current  and  accurate  records  of  each  student's  placement  and 
progress  -  information  which  also  Is  used  in  Instructional  planning. 

One  of  the  most  salient  findings  of  the'  analysis  of  program  features  Is  that  all  of 
the  programs  emphasize  the  importance  of  incorporating  a  broad  range  of  demonstrably 
effective  strategies  and  practices.  No  one  specific  set  of  strategies  b  claimed  by  any  of 
the  programs  to  be  a  panacea  for  solving  all  educational  problems.  The  wide  variety  of 
strategies  and  practices  adopted  by  the  eight  programs  for  accommodating  student 
differences  range  from  teacher-led,  group  instruction  to  student-initiated,  individualized 
activities;  from  peer  tutoring  to  student-cooperative  work;  and  from  the  use  of 
coaUngency  contracts  to  student  choice  and  scheduling  of  activities.  Thus,  each  of  the 
programs  includes  in  its  design  a  core  of  instructional  practices  (not  unlike  those  cited 
most  frequently  In  the  effective-teaching  literature)  that  are  implemented  in  various 
ways  to  meet  school  Improvement  needs  and  goab. 

Learning  Processes  as  Outcomes  of  EfTectiye  Schooling 

Throughout  the  hbtory  of  formal  education.  Improving  students'  ability  to 
function  as  active  learners  who  assume  responsibility  for  the  acqubition  of  knowledge 
and  skilb  and  are  motivated  to  sustain  patterns  of  self-directed,  life-long  learning  has 
been  prominently  and  consbtently  identified  as  a  major  objective  of  schooling.  It  b 
generally  agreed  that  a  basic  foal  of  education  b  to  enable  individual  students  with 
diverse  learning  characterbtics  and  needs  to  acquire  those  fundamental  sklib  that 
facilitate  continuing  learning  as  well  as  positive  feeiing3  about,  and  confidence  in,  their 
personal  capabilities  for  achieving  schooling  success.  The  crucial  task  in  achieving  thb 
educational  goal  b  to  find  ways  of  helping  schoob  to  become  increasingly  effective  in 
creating  learning  environments  that  not  only  foster  basic  skilb  development  but  abo 
prepare  students  to  make  the  educational,  occupational,  and  professional  choices  that 
each  person  deserves  the  chance  to  make.  Each  student  should  be  empowered  with  the 
knowledge  and  skilb  required  to  think  and  to  participate  in  and  shape  the 
socioeconomic  and  political  worlds  in  which  he  or  she  lives. 

Recent  theoretical  advances  and  expanded  'empirical  bases  regarding  the  nature  of 
learning  and  instruction  and  the  effects  of  innovative  educational  programs  provide  a 
rich  daiii.  base  for  furthering  our  understanding  and  characterization  of  students' 
knowledge  and  sklib  acqubition  and  their  effective  functioning  In  the  schooling  process. 
This  data  base  has  broadened  our  conceptualization  of  the  learning  process  and  learner 
V.  outcomes. 
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There  has  been  a  major  shift  in  the  kinds  of  information  on  student  iearning  that  , 
are  being  gathered  by  researchers  and  practitioners.  A  preoccupation  with  information 
on  achievement  in  basic  skiils  acquisition  gradually  has  given  way  to  an  emptasis  on  the 
different  cognitive  processes  that  are  used  by  individual  students  to  mediate  the 
acquisition  and  retention  of  knowledge  and  skiils.  Instead  of  characterizing  student 
iearning  solely  by  outcome  measures,  there  has  come  to  be  increased  recognition  of  the 
importance  of  analyzing  the  processes  by  which  individuals  learn  as  well  as  the  specific 
ways  in  which  variations  in  learning  performance  are  related  to  the  adoption  of 
particular  learning  processes  for  specific  tasks  by  individual  students.  More  and  more, 
iearner  differences  are  characterized  la  terms  of  the  manner  in  which  information  is 
processed,  the  mental  mechanics  and  niies  that  students  bring  to  the  instructional 
environment,  the  motivation  and  affective  response  tendencies  involved  in  the 
acquisition  and  retention  of  knowledge,  and  the  knowledge  and  competence  of  individual 
students  (cf.  Wang  &  Lindvall,  1984). 

Growing  research  evidence  sug^  s  a  wide  range  of  variability  in  the  ways  that 
students  acquire,  organize,  retain,  and  generate  knowledge  and  skills.  As  a  result, 
researchers  and  practitioners  are  giving  increased  attention  to  instruction  that  is  based 
on  the  specific  learning  needs  of  individual  students.  These  needs  are  identified  through 
analysis  of  the  processes  by  which  students  acquire  and  retain  knowledge  and  skills. 
Rather  than  being  viewed  as  static,  such  learner  characteristics  have  come  to  be 
considered  alterable.  Concomitantly,  learner  characteristics  are  less  likely  to  be 
identified  through  traditional  tests.  Instead,  they  are  identified  and  described  according 
to  the  manner  in  which  students  process  information  and  the  knowledge  and 
competence  they  possess  for  specific  learning  tasks  (cf.  Glaser  &  Bond,  1981). 

This  changing  conception  of  the  Individual's  learning  process,  combined  with 
recent  developments  in  research  on  ciassroora  processes,  has  many  implications  for  the 
ways  in  which  learning  and  Instnictfon  are  examined  and  described..  Of  particular 
interest  is  the  reexamination  of  students*  role  in  the  learning  process  and  the 
relationship  between  studentV  fuuctlonlng  in  classroom  learning  and  learner  outcomes. 
In  this  context,  students  are  conceptualized  as  active  information  processors, 
interpreters,  and  synthesizers  (e.g..  Brown,  1978;  Doyle,  1979;  Segal,  Chlpman,  & 
Glaser,  1935;  Wang  &  Peveily,  In  press).  Individual  learners  are  expected  not  only  to 
take  greater  responsibility  for  managing,  monitoring,  and  evaluating  their  learning,  but 
also  to  be  Instnimentai  in  adapting  the  learning  environment  to  their  nt^eds  and  goab 
(e.g.,  identifying  and  obtaining  learning  resources)  and  adjusting  themselves  to  the 
demands  of  the  learning  process. 

Underlying  ih\%  view  of  the  active  learner  role  is  the  assumption  that  essentially 
all  learning  involves  both  external  and  internal  adaptation.  External  adaptation  occurs 
in  the  ideas  and  content  that  are  to  be  learned  and  In  the  modes  and  forms  In  which 
content  Is  presented  to  the  learner.  Internal  adaptation  takes  place  In  the  learner's 
mind  as  new  content  Is  assimilated  and  internal  mental  structures  are  modified  to 
accommodate  the  new  content.  Operation allzlng  the  view  that  students'  ability  to 
make  adaptations  in  their  learning  process  Is  an  individual  difference  variable  with 
significant  relevance  for  schooling  success  requires  descriptions  of  greater  varieties  of  ) 
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learner  competencies. 
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Three  examples  of  Information  on  learnlng-as-adaptation  are  discussed  here  as 
Illustrations  of  candidate  items  for  broadening  the  NCES  data  base  to  include  indicators 
of  learning  outcomes  beyond  standardized  achievement  seores. 

Use  of  Resources 

In  mobt  learning  environments,  students  are  encouraged  to  use  a  variety  of 
resources  (e.g.,  time,  curriculum  materials,  instruction'* I  and  management  help  from 
teachers  and  peers)  to  facilitate  completion  of  their  schoo»^ng  tasks.  Even  in  classrooms 
where  this  I?  not  the  case,  successful  learners  have  been  found  to  seek  out  and  use 
supplementary  resources.  For  example,  in  situations  where  the  emphasis  is  on  large- 
group  instruction  and  where  the  only  form  of  in-ciass  presentation  is  the  teacher's 
lecture,  successful  students  make  adaptations  such  as  seeking  supplementary  reading 
sources,  discussing  lesson  content  with  fellow  students,  spending  greater-than-usua! 
amounts  of  time  on  particular  tasks,  and  arranging  for  personal  conferences  with  the 
teacher.  One  important  difference  between  programs  that  provide  for  individual 
differences  and  more  conventional,  group-paced  programs  is  the  former's  built-in 
provision  for  assisting  students  in  making  these  types  of  adaptations  (e.g.,  by  making 
alternative  materials  available,  using  a  variety  of  instructional-ieaming  procedures, 
allowing  varying  amounts  of  time  for  individual  students  to  learn  and  to  receive 
additional  information).  Descriptions  detailing  the  nature  and  patterns  of  students'  use 
of  resources  to  facilitate  their  learning  are  likely  to  provide  an  important  data  base  for 
characterizing  an  aspect  of  student  competence  that  is  integral  to  effective  learning. 


Study  Strategies  and  Use  of  Specific  Lesson  Materials 

Different  learners  who  study  the  same  chapter  in  a  textbook,  listen  to  the  same 
lecture,  or  have  any  other  common  exposure  to  presentation  of-  a  lesson  probably  use 
different  techniques  in  adapting  lesson  materiab  to  their  individual  methods  of  learning. 
One  may  attempt  to  outline  the  chapter  while  reading  it.  Another  may  first  scan  the 
chapter  and  formulate  questions  that  he  or  she  will  seek  to  answer  while  reading.  Still 
another  learner  may  underline  key  sentences  during  the  first  reading  and  then  reread 
the  underlined*  sentences  In  a  review  of  the  chapter.  Indlviduab  develop  such  techniques 
to  adapt  lesson  materials  to  ^\elr  learning  needs. 

Many  teachers  typically  assist  students  In  thte  type  of  adaptation  by  providing 
instruction  on  study  strategies,  but  it  is  likely  that  most  students  learn  "how  to  learn" 
very  much  on  their  own.  Data  on  students'  use  of  study  strategies  or  skills,  such  as 
various  aids  to  the  comprehension  of  text,  specific  techniques  for  facilitating 
memorization  of  essential  content,  effective  problem-solving  skilb,  and  related 
procedures,  may  constitute  Important  Information  for  curriculum  developers  and 
teachers.  This  kind  of  data  base  is  likely  to  increase  their  understanding  and  their 
capabilities  to  help  students  become  increasingly  more  competent  in  adapting  lesson 
materiab  and  in  n^'^lng  the  kinds  of  internal  adaptations  that  facilitate  learning. 
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Learning  Behaviors  and  Motivation 


Much  research  on  adjustments  in  classroom  learning  has  focused  on  cognitive 
process  requirements  in  subject-matter  learning.  However,  the  goals  of  effective 
schooling  obviously  include  learning  in  areas  other  than  subject-matter  achievement. 
Findings  from  research  suggest  that  certain  <'iassroom  environments  may  be  more  or 
less  conducive  to  the  development  of  schooling  outcomes  that  are  equally  as  valuable  35 
subject-matter  learning.  These  outcomes  include  positive  attitudes  toward  learning, 
motivation  for  life-long  learning,  independence  and  self-responsibility,  and  social  and 
personal  skills.  Moreover,  some  student  characteristics  (e.g.,  achievement  level, 
affective  response  tendencies,  temperament,  perceptions  of  task/environment  demands 
and  affects,  self-concept,  work  habits)  are  more  or  less  effective  than  others  in  response 
to  certain  task/environment  demands. 

A  data  base  on  such  behavioral  patterns  would  greatly  Increase  teachers* 
understanding  of  stu^^nts'  functioning.  The  individual  learner  possesses  a  unique 
profile  of  Instructionally  relevant  characteristics  which,  in  their  Interaction  with 
particular  elements  in  the  classroom  learning  environment,  elicit  particular  learner 
behaviors  that  may  or  may  dog  facilitate  certain  learning  conditions.  The  roles  students 
are  expected  to  play  or.  In  other  words,  the  adjustments  students  are  required  to  make 
in  their  behavior  and  their  motivation  for  effective  functioning  In  different  classrooms, 
are  likely  to  vary  greatly.  Students'  functioning  In  ciassroonos  that  are  characterized  by 
a  preponderance  of  teacher-directed  activities  involving  students  working  as  a  whole 
class  at  the  same  pace  b  likely  to  be  very  different  from  students'  functioning  In  ^ 
classroom  environments  that  are  characterized  by  the  predominance  of  flexible 
instructionai-grouping  patterns,  student  responsibility  and  Initiative,  the  availability  of 
a  variety  of  materials,  peer  assistance,  and  adequate  time  for  teachers  to  respond  to 
students'  requests  for  assistance. 

Reeommendatioot  of  Specific  Types  of  Data 

Two  lines  of  specific  Information  are  suggested  for  inclusion  in  the  NCES  data 
base.  They  are  (a)  information  on  the  school  and  classroom  learning  environments,  and 
(b)  information  on  student  outcomes.  It  is  important  to  note  that  the  recommended 
foci  are  meant  to  broaden  the  current  NCES  data  base,  not  to  replace  It.  Status 
information  such  as  achievement  test  scores,  school  demographics,  and  information  on 
instructional  and  related  service  staff  Is  viewed  as  being  Important  for  future  planning 
-  but  at  a  different  level.  The  kinds  of  data  on  the  learning  environment  and  student 
outcomes  discussed  in  this  paper  would  constitute  additional  components  of  the  NCES 
data  base  that  would  address  more  directly  many  of  the  current  ''quality  of  education** 
concerns.  These  data  are  summarized  In  Tables  1  and  2. 

Table  1  is  a  sample  list  of  educational  goals  and  corresponding  expected  student 
outcomes  that  are  Included  In  the  recommended  Information  foci  —  the  classroom 
learning  environment  and  a  broad  array  of  expected  outcomes.  Based  on  analysis  of  the 
research  bases  on  schooling  requirements  and  the  outcomes  of  effective  schooling  that 
are  discussed  In  this  paper  and  iwhere  (cf.  Good,  198S;  National  School  Public 
Relations  Association,  1981;  Wang  &  Walberg,  IMS;  WIttrock,  In  press),  four  major  ^ 
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Table  1 

Educational  Goals  and  Examples  of  Expected  Student  Outcomes  of  Effective  Schooimg 


Educational  Goals 

Examples  of  Expected  Student  Outcomes 

Mastery  of  subject-maner  content 


Mastery  of  the  curriculum  content  and  skills  necessary  for 
effective  functioning  and  further  learning  (e.g.,  the  conventional 
basic-skills  subjects  such  as  reading,  math,  social  studies,  and 
science;  as  well  as  learning  skills  such  as  reasoning,  remembering, 
comprehension,  problem  solving,  oral  communication,  and 
writing) 


Acquisition  of  a  variety  of 
learning  skills 


Ability  to  study  and  learn  independently 

Ability  to  plan  and  monitor  one's  own  learning  activities 


Ability  to  obtain  needed  assistance  from  others  and  provide 
assistance  to  others  in  learning  situations 


Development  of  positive  attitudes 
toward  learning 


Enjoyment  in  taking  part  in  learning  activities 

Viewing  the  receiving  of  help  from  peers  and  the  assisting  of 
others  in  their  learning  as  positive  learning  experiences  that  are 
integral  to  the  classroom  learning  process 

Special  interest  In  certain  learning  areas 

Motivation  to  continue  learning  and  to  persist  in  overcoming 
learning  difficulties 


Development  of  positive  self-  •  Confidence  in  one's  ability  as  a  learner 

perceptions 


•  Confidence  in  oneself  as  a  contributing  member  of  the  school/ 
community 

•  Confidence  in  one's  ability  to  take  self*responsibility  for  learning 
and  behavior 

•  Perc  ptions  of  internal  locus  of  control 
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Tabte  2 

Examoiesof  Features  of  Effective  Classroom  Learning  Environments  and  Exoected  Student  Outcomes 


Examples  of  Exoected  Student  Outcomes 


Features  of  Classroom 
Learning  Environments 


Mastary  of 

content  and 
skills  for 
effective 
functioning 


Mastery  of 
content  and 
Skills  for 
further 
learning 


Ability  to 
study  and 
learn 
indeoen- 
dently 


Ability  to 
olan  and 
monitor 
learning 
acttv  ties 


Ability  to 
obtain 
assistance 
from  others 


En;oyment  m 
taking  part 
tn  learning 
activities 


Instructional  contant  that  is: 

•  essential  to  further  learning 

•  useful  for  effective 

functionina  m  school 
and  in  society  at  large 

•clearly  soecified 

•  organized  to  facilitate 

learning 


X 
X 

X 
X 


X 
X 

X 
X 


X 
X 
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Assessment  and  diagnosis  that: 

•  provide  appropriate  place* 

mtnt  in  the  curricula 

•  provide  rtgular  aisasament  of 

progress  and  feedback 

Learning  axp#riencaa  in  which: 

•  ample  tima  and  instructional  X 

support  are  provided  for 
each  student  to  acquire 
essantial  content 

•  dimiptivvness  is  minimized  X 

•  students  wst  •ffecttve  learning  X 

stntegiM/study  skills 

•  each  studgnt  is  expacted  to  X 

end  actually  expetlencas 
Hjccess  in  achieving  master/ 
of  curriculum  content,  and 
accompllshmants  are  rainforcad 

•  eltamativa  instructional  X 

strategias,  student  assignments, 
and  activities  are  used 

Managamant  of  imtruesion  that; 

•  parmits  each  student  to  master 

many  lessons  through 
independent  study 

•  pemilts  each  student  to  pten  his  ' 

or  her  own  learning  aetivitiet 

•  provides  for  students'  tetf- 

moflitoring  of  thair  progress 
with  most  lessons 

•  permits  students  to  Plr'  a  pea 

in  selecting  some  learning 
goels  and  activities 

Collatoration  among  students  that: 

'  •  enebles  students  to  obtain  X 
necessary  help  from  pears 

•  encoureges  itu'Jents  to  provide  help  X 

•  provider,  tor  c^jtlaboration  in  X 

group  activities 


X 
X 


X 
X 


X 
X 
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X 
X 


X 
X 


X 
X 
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Table  2  (cont.) 

Examples  of  Features  of  Effective  Classroom  Learnmg  cnvfronments  and  Expected  Student  Outcorres 


( 


Examples  of  Expected  Student  Outcomes 


Features  of  Classroom 
Learning  Environments 


Viewing 
help-giving 
and  help- 
receiving  as 
positive 
txpenences 


Special       Motivation    Confrdence  m  Confidence  Confrdence  Percbpt<ons 

interest       T.^r  con-        one's  ability     m  oneself  in  one's  of  internal 

»n  certain    tinuing        as  a  as  a  con-  ability  to        locus  of 

learning      learning       learner  tributing  take  self*  control 

areas  member  of  responsibility 

the  school/  for  learning 

community  and  behavior 


tnftnicttonti  conttnt  that  is: 

•  essential  to  further  learning 

•  useful  for  effective 

functioning  in  school 
and  m  society  at  large 

•  ciMrly  sotctf ltd 

•  organized  to  faciiitatt 

learning 


X 
X 


X 
X 


AtMssmunt  and  diagnoiii  that: 

•  provide  appropriate  place*  ^ 

ment  in  the  curricula 

•  Provide  regular  assessment  of 

progress  and  feedback  ' 


X 

X 


X 
X 


Learning  axp«rianc«t  in  which: 

•  ample  time  and  instructional 

support  are  provided  for 
each  studtnt  to  acquire 
essential  content 

e  disrupttveness  is  minimized 

e  students  use  effective  leeming 
stntegies/study  skills 

•  eech  student  Is  expected  to 

end  actuelly  experiences 
success  in  echieving  mestery 
of  curriculum  content,  and 
eccomplishments  ere  reinforced 

•  elternetive  instructionel  - 

stretegies,  student  assignments* 
end  activitlM  ere  used 

Menegement  of  inetnicdon  thet: 
e  permits  eech  student  to  meiter 
many  lessons  through 
independent  study 

•  pemiits  eecn  student  to  pien  his 

or  her  own  leeming  ectivitles 

e  provides  for  students'  lelf* 
monitoring  of  their  progress 
with  most  lessons 

e  permits  students  to  play  e  pert 
in  selecting  some  learning 
goels  end  ectivities 


X 
X 


X 
X 


X 
X 


X 
X 


X 
X 


X 
X 
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Collaboretlon  emong  sttidents  thet: 
e  enebiM  students  to  obtein 
necessery  help  from  peers 

•  encoureges  students  to  provide  help 

•  provides  for  collaboration  in 

group  ectivities 


X 
X 


X 
X 
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X 
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X 
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educational  goals  of  effective  schooling  have  been  delineated.  As  shown  In  Table  1, 
these  goals  are  (a)  mastery  of  subject-matter  content,  (b)  acquisition  of  a  variety  of 
learning  skills,  (c)  development  of  positive  attitudes  toward  learning,  and  (d) 
development  of  positive  self-perceptions. 

Table  2  provides  a  summary  list  of  program  features  that  are  suggested  Id  the 
literature  to  be  facllltatlve  in  fostering  the  variety  of  expected  studen:  outcomes  of 
effective  schooling.  Referring  to  the  table,  for  example,  the  feature  "assessment  and 
diagnosis  that  provide  appropriate  placement  In  the  curricula"  is  associated  with  at 
least  four  expected  student  outcomes  -  mastery  of  content  and  skills  for  further 
learning,  ability  to  study  and  learn  independently,  motivation  for  continuing  learning, 
and  confidence  In  one's  ability  as  a  learner. 

ImpIieatioDB  for  Use  of  the  NCES  Data 

Base  in  School  Improvement 

As  previously  mentioned,  the  recommendation  to  broaden  the  NCES  data  base  to 
include  Information  on  conditions  of  learning  (the  context  of  ongoing  Innovative  school 
improvement  efforts)  as  weil  as  student  outcomes  data  beyond  standardized 
achievement  test  scores  is  derived  ftom  an  "Improvement"  orientation  rather  than  a 
''forecasting"  orientation.  The  latter  orientation  is  predominant  in  the  design  of  most 
large-scale  data  bases»  Including  those  developed  and  maintained  by  NCES.  The 
underlying  assumption  of  thb  paper  is  that  trend  projections  are  simply  extensions  of 
the  past.  By  contrast,  the  proposed  improvement  orientation  recognizes  and  anticipates 
future  changes;  it  Integrates  forecasting  with  strategic  planning*  In  this  context, 
effective  data  bases  are  those  that  provide  the  foundation  for  developing  alternative 
futures  scenarios  and  for  making  informed  choices  that  strategically  "create"  futures. 

Selected  findings  ftom  the  prevlously-clted  observation  study  of  eight 
contemporary  educational  programs  (Wang  &  Walberg,  in  press)  are  discussed  here  to 
illustrate  the  potential  use  of  data  on  the  quality  of  education  (e.g.,  data  on  program  . 
features  and  classroom  processes)  for  planning  and  informed  decision  making.  The 
results  from  two  types  of  analyses  are  discussed' as  examples  of  potential  data  utilization 
-  findings  from  a  series  of  analyses  that  focused  on  delineating  differences  among  the 
eight  programs,  and  findings  from  a  series  of  analyses  of  relational  patterns  between 
features  and  classroom  processes. 

Differeneet  Among  Programe 

Findings  based  on  the  classroom  observation  data  suggest  some  significant 
differences  among  the  eight  programs*  For  example,  the  Bank  Street  Model  classes 
were  observed  to  have  the  highest  number  of  indicators  of  personal  Interactions  with 
teachers.  Programs  with  classrooms  that  were  observed  to  have  the  highest  numbers  of 
indicators  In  other  areas  included,  Mastery  Learning  -  teachers'  use  of  explaining  and 
demonstrating/'modellng;  the  Adaptive  Learning  Environments  Model  -  students 
working  on  Independent  tasks  In  group  settings,  use  of  exploratory  learning  materials, 
one-to-ohe  tutoring,  and  teachers  encouraging  student  self-responslblllty;  the  Behavior 
Analysis  Model      responding,  praising  behavior,  and  cueing  or  prompting;  Team*  J 
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Assisted  Individualization  -  constructive  student  Interactions,  students  working  aione 
^  on  independent  tasks,  students  assisting  in  classroom  management,  and  student 

assessment  of  task  difficulty:  and  the  Direct  Instruction  Model  -  small-group 
insiruction,  reading,  and  communicating  criteria. 

With  respect  to  classroom  processes  among  the  eight  programs,  the  Adaptive 
Learning  Environments  Model  and  Team-Assisted  Individualization  were  observed  to  be 
most  prominent  and  distinctive.  Classes  using  these  two  programs  had  the  most 
indicators  of  adaptive  Instruction.  The  Adaptive  Learning  Environments  Model  classes 
were  observed  to  feature  constructive  student  Interactions,  encouragement  of  self* 
management,  student  choice,  exploration,  and  the  teacher  acting  as  manager  and 
consultant  rather  than  as  disciplinarian  or  lecturer  for  the  whole  class  or  small  groups. 
In  the  Team*Asslsted  Individualization  classes,  students  were  observed  to  work 
Individually  on  written  assignments  and  tests  and  quizzes;  the  teacher's  role  was  to 
diagnose  and  assist. 

As  a  further  example  of  how  results  from  analyses  of  the  patterns  of  similarities 
and  differences  In  program  features  can  be  used  to  analyze  the  quality  of  the  learning 
environment  under  each  program,  the  observation  data  are  summarized  in  Figures  1-A 
through  1-D.  For  Illustrative  purposes,  the  eight  programs  are  referred  to  by  letters  In 
the  figures.  Figure  1-A  shows,  for  example,  that  Program  A  was  tightly  clustered 
around  the  mean  T-score  of  50  and  appeared  to  be  the  most  typical  or  representative  of 
the  eight  programs;  that  Is,  It  was  neither  positively  nor  negatively  distinct  from  the 
other  programs.  Program  B,  although  slightly  above  the  mean  in  other  respects,  was 
(  notable  for  scores  below  the  mean  on  the  variables,  learning  centers  and  materials  in 

order.  Program  C  was  sharply  above  the  mean  in  all  five  physical  design  features. 
Programs  D,  B,  and  G  were  clustered  close  to  the  mean  in  most  respects.  Program  F 
had  notably  high  scores  on  all  features  except  classroom  arrangement,  on  which  it  was 
two  standard  deviations  below  the  mean.  Program  I  was  fairly  low  in  all  physical 
design  features. 

Relational  Patterns 

The  results  from  a  series  of  canonical  correlation  analyses  of  the  data  on  program 
features  and  classroom  processes  suggest  that  when  controlling  for  socioeconomic  status, 
program  features  were  closely  associated  with  classroom  processes,  and  both  sets  of 
variables  predicted  students*  perceptions  of  classroom  climate.  Program  features  alone 
were  found  to  predict  students*  perceptions  of  self-responsibility;  classroom  processes 
alone  were  found  to  predict  students*  adjusted  achievement  outcomes.  Furthermore, 
results  from  the  canonical  correlations  specifically  linked  program  features  and 
classroom  processes.  Eleven  program  features  ^  student  choice,  task  flexibility,  teacher 
monitoring,  peer  tutoring,  students  seeking  adult  help,  record  keeping,  classroom 
arrangement,  task  directtons,  learning  centers,  variety  of  materlab,  and  clear  labeling  — 
were  associated  with  classroom  processes  such  as  student  use  of  exploratory  materials, 
student  work  in  parallel  groups,  teachers  interacting  with  students  on  personal  matters, 
student  self-management,  and  student  participation  in  presentations.  It  is  noteworthy 
that  the  same  11  program  features  were  found  to  be  associated  negatively  with 
classroom  processes  such' as  students  working  in  group-interactive  settings,  whoie-ciass 
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Figure  1-A:  PROGRAM  FEATURE  PROFILES: 
Physical  Design  of  the  Classroom 
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Rgure  HB:  PROGRAM  FEATURE  PRORLES: 
Curriculum  Materials 
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Figure  1-C:  PROGRAM  FEATURE  PROFILES: 
Provision  of  Adaptive  Instruction  (a) 
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Rgure  1-D:  PROGRAM  FEATURE  PRORLES: 
Provision  of  Adaptive  Instruction  (b) 
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and  smali-group  instructioD,  teacher  instructioD,  teacher  questiODing,  and  no  use  of 
materials.  Also  of  Interest  are  the  results  showing  that  classes  which  were  observed  to 
combine  the  program  features,  clear  labeling,  learning  centers,  less  teacher  monitoring, 
Informal  evaluation,  students  seeking  adult  help,  and  diagnostic  testing,  also  were 
observed  to  be  characterized  by  the  classroom  processes,  constructive  student 
Interactions,  student  participation  in  presentation?,  less  teacher  explaining  and  cueing 
or  prompting,  and  Interactions  with  students  for  Instructicnai  purposes.  The  overall 
patterns  of  relationship  between  program  features  and  classroom  processes  suggest  the 
contrast  between  instructional  features  that  are  adaptive  to  student  differences  (e.g., 
one-to-one  and  smaii-group  tutoring)  and  the  traditional  instructional  practices  that 
have  been  predominant  since  the  turn  of  the  century  (e.g.,  the  recitation  method  of 
questioning,  teacher  instruction  in  whole-class  or  small-group  instructional  settings).  In 
addition,  the  results  show  that  classrooms  featuring  the  greatest  use  of  Individualized 
prescriptions,  task  flexibility,  students  seeking  adult  help,  a  variety  of  materials,  and 
clear  delineation  of  task*speclflc  directions  were  associated  most  closely  with  high  leveb 
of  student  responsibility.  These  program  features  also  were  associated  with  greater 
student  perceptions  of  competitiveness  and  friction,  and  lesser  student  perceptions  of 
cohesiveness  and  satisfaction. 

Findings  from  the  analyses  also  show  that,  on  average,  programs  with  more 
features  of  adaptive  instruction  tend  to  raise  achievement  and  student  self* responsibility 
to  levels  as  great  as,  or  better  than,  those  found  for  programs  that  feature  more 
teacher-directed  and  group-paced  instructional  strategies.  In  addition,  several  of  the 
programs  with  the  primary  goal  of  providing  for  student  differences  produce  superior 
classroom  processes  that  many  students,  parents,  and  educators  greatly  value.  These 
include  constructive  student  Interactions,  independent  work.  Individual  diagnosis  and 
prescription,  cooperative  learning,  student  exploration,  and  teachers  Interacting  with 
students  on  personal  matters. 

Overall,  findings  such  as  those  discussed  abov«  make  It  possible  to  delineate 
relationships  between  specific  program  features  and  classroom  processes  and  student 
learning  outcomes.  The  results  show  that,  when  they  are  well-Implemented,  features 
such  as  the  allocation  of  available  class  time  for  curriculum-related  activities,  a  variety 
of  Instructional  strategies,  a  variety  of  materials  and  activities,  and  learning  taslcs  that 
are  appropriate  for  students*  learning  needs  and  achievement  levels,  can  produce 
superior  classroom  processes  and  achievement  results  that  are  not  unlike  those 
associated  with  ideal  realizations  of  traditional,  teacher-directed  and  group-paced 
instruction.  Moreover,  features  such  as  student  choice,  which  is  suggested  Id  the 
effective-teaching  literature  to  be  an  Ineffective  feature  of  adaptive  instruction 
programs,  actually  were  found  to  facilitate  student  learning. 

In  light  of  the  findings  from  the  observation  study  discussed  above  and  from  the 
quantitative  synthesis  of  adaptive  Instruction  programs  by  Waxman  et  al.  (1985) 
described  earlier  In  this  paper,  and  given  the  current  push  for  educational  excellence 
and  basic  skills  acquisition.  It  seems  critical  to  begin  accumulating  further  evidence  that 
verifies,  or  contrasts  with,  the  predominant  literature  supporting  the  efficacy  of  group- 
paced,  teacher-directed  Instruction.    One  of  the  central  arguments  of  the  extant 
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effective-teaching  literature  is  that  programs  which  make  allowances  for  individual 
differences,  student  Initiative,  and  student  self-responsiblUty  for  learning  tend  to  be 
ineffective  in  increasing  tlme*on-task  and  basic  skills  acquisition,  while  a'-^o  being 
Impractlcai  for  widespread  Implementation  in  regular  classroom  settings  (e.g.,  Bennett, 
1QT6;  Brophy,  1979;  Hedges,  Glaconia,  &  Gage,  1981).  Findings  from  the  observation 
study  by  Wang  and  Walberg,  as  well  as  those  from  the  Waxman  et  ai.  (1985) 
quantitative  synthesis,  are  a  counterpoint  to  this  argument.  In  particular,  the  results 
from  the  Wang  and  Walberg  study  are  pertinent  for  two  important  reasons.  First,  they 
illustrate  that  high  degrees  of  implementation  of  adaptive  Instruction  features  in  regular 
classrooms  can  be  established  and  maintained  In  a  variety  of  school  settings.  Second, 
they  show  that  although  different  Instructional  approaches  were  In  use,  there  seemed  to 
be  a  :lose  .resemblance  In  observed  classroom  processes  between  the  exemplary 
classrooms  of  the  p  ^  ms  Included  In  the  study  and  Instructionally  effective 
classrooms  as  portrayea  the  effective-teaching  research  literature.  In  this  context, 
these  studies  represent  an  Important  step  toward  accumulating  the  kind  of  data  base  on 
Instructional  features  that  currently  Is  soreFy  lacking.  Information  of  this  sort  is  critical 
for  zr<iklng  Infom^id  choices  from  among  alternative  educational  models  and  for 
strategic  planning  aimed  at  creating  alternative  futures  scenarios  with  the  goal  of 
Improving  current  practice. 


This  paper  presents  a  case  for  gathering  Information  on  specific  features  of  school 
learning  environments  that  are  effective  In  maximizing  aii  students'  chances  for 
schooling  success,  particularly  the  chances  of  success  for  students  who  require  greater- 
than-usua!  educational  support.  Examination  of  .  search  and  practice  supports  the 
contention  that  information  on  learning  envljronments  or  conditions,  combined  with  a 
broadened  data  base  on  student  outcomes,  can  greatly  enhance  Innovative  program 
development,  school  Implementation,  and  strategic  planning.  -  Receuv  studies  with 
Implications  for  increasing  the  effectiveness  of  schooling  come  ftom  virtually  all  areas  of 
research  on  human  development  and  learning,  as  well  as  from  Investigations  of  effective 
teaching  and  classroom  processes.  This  research  Is  adding  substantially  to  our 
understanding  of  learner  competence,  of  how  such  compw'^ence  is  acquired,  and  of  some 
key  characteristics  of  effective  schooling. 

The  Important  leadership  role  of  NCES  is  Implicit  In  the  recoomiendatlons 
discussed  In  this  paper  for  building  upon  the  <^urrent  research  base.  This  role  dictates 
an  Improvement  orientation  whereby  data  on  the  quality  of  education  are  used  (a)  *to 
assist  educators  and  educational  policy  makers  by  Informing  their  decisions  and  to  assist 
the  general  public  by  describing  the  'health'  of  American  education*  (U.  S.  Department 
of  Education,  1985);  and  (b)  to  create  alternative  futures  scenarios  and  conduct  related 
rategic  planning.  Thus,  NCES  is  called  upon  to  greatly  expand  its  current  focus  on 
disseminating  information  for  the  purposes  of  trend  analjrsis  and  forecasting;  It  is 
challenged  to  accept  responsibility  for  increasing  the  relevance  of  Its  data  base  to 
educatcrs  and  .  ollcymakers  as  well  as  providing  the  general  public  with  information 
tha\r  can  be  used  In  making  Informed  choices  trom  among  different  schf^ang 
approaches:  The  ultimate  goal  is  for  NCES  to  make  available  information  that  is  most 
timely  and  relevant  to  Informed  decision  making  by  educational  planners  and  Informed 
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choices  by  the  public  -  the  primary  consumers  of  educational  Improvement. 


This  is  a  special  period  in  Amfrican  education.  The  peryasi^''eiiess  of  the  sense 
that  we  must  somehow  improve  the  quality  of  schooling  is  reflected  in  over  30  major 
national  reports  and  in  the  creation  of  over  300  state  task  forces  on  the  general  quality 
of  education  (Cross,  1984).  Improvement  efforts  are  under  way,  and  many  of  them 
have  considerable  potential.  The  current  w&ve  of  educational  reform  underscores  the 
leadership  role  of  NCES  in  pooling  the  resources  and  capabilities  of  other  federal,  state, 
and  local  information-gathering  &(;encies.  Only  In  this  way  can  progress  be  made  in 
systematically  building  data  bases  mat  go  beyond  the  predominant  focus  on  the 
socioeconomics  of  education  and  address  issues  related  to  improving  the  quality  of 
educational  practice. 
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Assessing  Students'  Social  and  Coaaunlcative  Coapetence  in  School 

Louise  Cherry  Uilkinson 
City  University  of  Net  Vork,  Graduate  School 

Rs  part  of  the  national  effort  to  aeasure  the  progress  of 
eleientary  and  secondary  students  in  Raerican  schoolsi  their  social 
and  coHunicative  perforiance  should  be  assessedi  and  the 
classroois  in  thich  they  acquire  knot I edge  should  be  described,  i 
share  the  position  held  by  lany  educators  lhat  the  educational 
statistics  coMected  about  our  children  md  sbeut  eur  eehoeis  hove 
had  iiiited  utiilty  and  questionable  validity, 

Past  surveys  of  the  status  of  flier icon  education  have  not 
fully  described!  nor  have  they  validly  predicted  the  voys  In  ehich 
students  leom  and  achieve  in  school.  One  reaeon  for  this  failure 
is  that  the  pr  i  or  ana  I  yses  have  not  i  ncl  uded  de^scr  i  pt  i  ons  of 
ciassroois.  Another  reason  is  thot  they  hove  not  included  leosuree 
of  liportont  oepects  of  school-oge  children's  sociol  and 
coHunicative  knooledge.  Social  knooledge  includes  the  ability  to 
perfori  functional ly  opproprlc^e  interpereonal  behaviorSj  ihi le 
coiaunicotive  knooledge  includeo  the  ability  to  uee  verbal  and 
vocal  expression  to  coMunicote,  Rchieving  a  sense  of  outonoiy  and 
responsibi I ityi  coiiunicating  effectively  oith  otherej  cooperating 
oith  others  and  eolvlng  Interpersonal  probleiSj  are  all  olthin 
these  dooains  of  knooledge.  They  change  draiatically  during  the 
school-age  years  and  a^e  heavily  Influenced  by  students' 
exi^eriencee  in  classrooie.  Social  and  cciiunlcative  coipetence  are 
iopcrtant  achieveoents  that  the  educational  systei  can  either 
foster  or  discourage.     They  shouldi  thereforej  be  included  In 
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descriptions  of  flier icon  education. 

In  this  paperj  i  coaaent  on  the  present  slate  of  statistical 
descriptions  of  Roerican  education.  Then  I  discuss  the  need  for 
nev  aeasures  that  assess  the  social  and  coHun i cat  i ve  coapetence  of 
students  and  the  ciiaate  of  their  classrooas.  Final iyj  I  offer  soae 
suggestions    for  acre  coaprehensive  assessaents. 

Descriptions  of  Students'  flchieveaent  and  Their  Clossrooas 

Ouer  the  yearSj  I  urge  aaounts  of  i  n  f oraat  i  on  have  been 
collected  on  student  characteristics  and  student  outcoaes  as 
indicators  of  the  state  of  Raericon  education.  It  is  appropriate 
and  logical  that  these  descriptions  focus  on  students*  acadeaic 
achieveaent  in  specific  curricular  areas j  such  as  arithaatic  or 
reading I  and  basic  verbal ,  spatialj  and  aatheaatical  aptitudes. 
Past  reports  by  HCES  are  replete  «ith  descriptions  such  as  the 
folloaing:  'SRT  Scores  for  Students  1963-1984/  "Eighth  grade 
Hatheiatics  Rchieveaent/  'National  Rssessient  of  Educational 
Progress  in  Reoding  for  Rges  9,  13|  17|  by  Selected  Characteristics 
of  Participants  In  the  United  States,  i971-l975|  and  1979-1980." 
These  reports  are  deficient  in  tio  areas.  (I)  They  neglect  social 
and  coaiunicat Ive  coapetence.  (2)  They  contain  virtually  no 
InforMtion  on  the  classrooas  in  ahlch  students  are  taught.  There 
is  lodest  Inforaotion  about  students  aith  Halted  Engish 
proficiency  and  soae  inforiatlon  on  foreign- language  enrol laentSj 
such  as  the  folloaing^  "The  Percent  of  5  to  17-year-olds  that 
Specie  a  Language  Other  Than  English  at  Ifoae/  "Estiaated  Language 
Hinority  Status  and  English  Language  Proficiency  of  Population  5  to 

H-jear-oldSi  1976  to  1902/  and  "The  (lean  Huaber  of  Carnegie  Units 

• 

Earned  by  Selected  Subject  Hatter  Rreas  (Foreign  Languages)." 


^  Expanding  Descpiotions  of  Students'  flchieueaent  and  Closspooas 

One  reason  for  aeasuring  students'  social  and  cooaunlcat ive 
coapetence  in  classsrooas  is  that  this  knoaledge  aediates  both  the 
t each  i  ng  and  I  earn i  ng  of  acadea  i  c  sub j  ect  s ,  Soc  i  a  I  and 
coaaunicat ive  coapetence  I iaits  the  extent  to  ahich  students  can 
benefit  froa  the  instruction  in  Qcadeaic  subjc^ct^  such  as  reading 
or  aatheaatics.  For.exaaplei  recent  research  in  sociol inguist ic 
studies  of  classrooas  provides  evidence  that  for  soae  studentSj  the 
•ays  of  coBBunicat ing  at  school  differ  froa  those  at  hoae 
(Uillcinsoni  1982).  Discontinuities  between  the  classrooa  and  other 
learning  environaentSi  such  as  the  hoaOi  aay  cause  special  probleas 
for  soae  students  that  can  interfere  aith  their  overall  achieveaent 
and  adjustaent  in  school.  ^  Soae  culturally  diverse  students  do  not 
knovi  nor  are  they  taught  the  "rules  of  the  gaae" — the  standard 
aays  of  coaaunlcat ing  in  cla99rooaS|  such  os  hoV|  vhenj  and  where 
to  ask  for  and  provide  inforaation  to  teachers  and  other  students. 
.  The  effects  of  students*  lack  of  knoaledge  obout  classrooas  are  not 
Malted  to  the  obvious  probleas  that  these  students  face  in  their 
failure  to  coaaun i cat e  adequately.  In  addition  to  such  iaaediate 
probleasi  if  eoae  children  do  not  understand  the  classrooa  aith  its 
un  i  que  coaaun i  cat  i  ve  deaande j  then  they  I earn  little  froa  the 
instruction  they  receive.  Inadequote  learning  of  hoe  to  coaaunicate 
in  classrooas  has  unintended  effects  that  include  lack  of 
underst and i ng  and  i nab 1 1 1 1 y  to  f unct Ion  in  c I oesrooae .  This 
problea  ie  deaonetratedi  for  exaaplOi  by  students  a isunderst endings 
of  the  curriculua  and  by  teachers'  loaered  expectations  that  can 

^  then    result    in    their    differential    treatient    of  students. 

FurtheraorOi  accurate  assessaent  of  the  student's  achieveaent  is 
unlikelyi  since  access  to  their  knoaledge  is  predicated  upon  good 
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coMun  teat  ion.  Perhap3  the  educational  failure  of  aoae  3tudentS| 
03  docuaented  by  educot i ono I  stot i 3t i C3|  is  caused  i n  part  by 
differences  in  coaaunicot ion  between  students  and  teachers  aho  coae 
froi  different  cultural  backgrounds. 

Hy  studies  of  students  and  classrooas  provide  an  exaaple  of 
the  i  nt  errel  at  i  onsh  i  p  aaong  'jcadea  i  c,  soc  i  a  1 1  and  coaaun  i  cat  i  w 
achiegeaents.  During  the  past  several  yearsi  ay  colleagues  and  I 
have  been  especially  interested  in  hoi  students  provide  inforaation 
to  one  and  otherj  and  hoi  they  use  requests  and  responses  in 
instructional  groups  in  ihich  the  teacher  i;^  often  absent,  flaking 
request S|  such  as  asking  for  inforaationi  and  receiving  adequate 
responses^  such  as  correct  ansiersi  are  central  to  teaching  and 
learning  in  classrooas.  Children  often  use  requests  to  provide 
inforaation  for  each  other  as  lell  as  to  guide  their  behavior. 
Requests  are  coaaon  in  classrooas i  accounting  for  about  tio-t birds 
of  all  of  the  teachers'  speechj  and  aore  than  one-half  of  students' 
speech t 

Ue  conducted  research  on  students'  In  s«GiI  'nstrwxt ional 
groups  and  proposed  a  aodel  that  describes  students'  use  cf 
requests  and  responses  in  these  groups.  The  central  Idea  of  the 
aodel  Is  the  concept  of  the  effective  soeakep.  iho  Is  successful  In 
coiBuni eating  ilth  others.  In  the  ease  of  requestSi  an  effective 
speaker  is  defined  as  one  iho  receives  appropriate  responses  to 
requests.  Our  aodel  Identifies  several  characteristics  of  requests 
that  are  assoc  i  ated  i i  th  obt a i  n 1 ng  appropr  i  ate  responses  for 
eleaentary  school  children;  these  characteristics  include  requests 
that  are  expressed  clearly  and  direct lyi  that  have  to  do  lith  the 
dcadeaic  task  at  handj  that  are  understood  by  other  students  as 
sincerSi  and  that  are  revised  if  they  do  not  initially  result  in 
obtaining  an  appropriate  responses.    The  results  of  four  studies  of 
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eleaentary  school  students  froa  first  through  third  grades  that  «e 
conducted  during  the  paet  eeueral  years  provide  support  for  our 
fiodel  (Uilkinson,  1982,  1983).  Requests  that  confers  to  iht  aodel 
are  aost  i  i ke i g  to  resu It  in  students '  obta I n t ng  appropr i ate 
resj)onses  during  their  reading  and  aatheaatics  in  saalli 
instructional  groups.  One  of  the  aost  provocative  findings  froa 
the  research  is  that  students  vho  lere  effective  in  obtaining 
appropriate  responses  not  only  produced  requests  that  conforaed  to 
our  aodei  but  aere  also  the  highest  achievers  in  reading  and 
■atheaatics  as  aeasured  by  standardized  tests.  Our  aork  and  that 
of  other  researchers  suggests  that  the  coaaunicat ive  cliaate  of  the 
classrooa  aay  help  to  aa into  in  and  encourage  di  f ferences  aaong 
students  in  their  aathea  tics  and  reading  achieveaent,  initial 
differences  aaong  students  in  their  acadeaic  achieveaent  and 
coaaunicative  knoaledge  aay  contribute  to  ihat  they  actually  learn 
in  clossrooBs  and  thus  affect  their  perforaance  on  standardized 
tests. 

.    flasessinq  Studcntg'  Social  and  Coaaunicative 

CoapBtcnca  In  Cloaarooas 
Ue  should  develop  and  adainister  assessaents  of  students' 
social  and  coaaunicative  coapetenca  In  classrooas.  R  set  of 
educational  etatlstics  that  purports  to  describe  the  state  of 
Raerican  education  should  Include  aeasureaents  of  the  social  and 
coaaunicative  coapetence  of  school-age  children.  I  all  I  suggest  a 
aay  o  f  deve I op  1 ng  adequat  e  I nd I cot  ore  t  hat  occur at  e I y  re  f I ect 
students 'coapetence  In  these  areas. 

The  task  of  aeasurlng  social  and  coaaunicative  coapetence  of 
schoof-age  children  In  school  is  dlfficulti  because  there  Is  no 
standard I zed j  group-ada I n I etered  test  that  accurate I y  and 
coaprehens I ve I y  assesses  t  hese  coapet enc  i  es •     To  t  he  cent  r ary , 
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research  duggeste  that  aeaeureaent  of  the3e  coapetenciee  is  tore 
accurately  reflected  by  direct  observation  of  students'  actual 
behavior  in  classrooas  than  by  test  scores. 

Rny  atteapt  to  aeasure  social  and  coaaunicat ive  coapetence 
should  be  guided  by  the  current  state  of  scientific  knoiledge.  The 
design  of  assessments  should  be  guided  by  conteaporary  theory  in 
ch  II  d  deve I opaent  and  I  earn  i  ng .  For  exaap I e,  one  cou I d  assess 
children's  ability  to  solve  social  probleas  (e.g.  Chandler^  I973)| 
to  coBBunicate  effectively  (e.g.  Krause  &  Glucksberg^  1969)^  to 
reason  about  coaplex  aora I  issues  (e.g.  Kohlberg^  I976)>  to  knoa 
about  the  social  relationships  in  classrooas  (e.g.  Cohen^  1961)^ 
and  to  understand  self-concept  (e.g.  Harter^  1984). 

It  is  essential^  hoaeveri  that  assessaents  also  include 
saaples  of  students'  nature I  behavior  as  it  occurs  in  classrooa. 
For  exaap I Oi  ae  have  constructed  profiles  for  each  student  based  on 
his/her  coaaunicat ive  effectiveness  in  one  classrooa  situation: 
the  saalli  instructional  group,  in  our  research  (Uilkinsoni  I982| 
1963)  the  profile  includes  the  folloaing:  (1)  the  conditions  under 
ahich  the  student's  requests  are  '  successful  in  obtaining 
Inforaationi  (2)  the  variety  of  aays  In  ahich  the  student  tries  to 
obtain  inforaationi  and  0)  the  student's  response  If  the 
inforaation  is  not  obtained.  Rfter  collecting  such  profllesi  ae 
aust.  consider  the  noras  against  ahich  the  profiles  are  coapared. 
iaportantlyi  ae  aust  be  sensitive  to  differences  that  are  priaarily 
due  to  the  individuali  versus  the  culture  (e.g.  dialect)  or  the 
situation  (e.g.  a  classrooa  situation  ahen  the  teacher  is  absent). 

The  design  of  future  assessaents  of  students*  achieveaent  in 
classrooas  should  include  both  longitudinal  and  cross-sectional 
designs I  so  that  trends  in  students'  social >  coaaunicat ive >  and 
acadeaic  achieveaent  can  be  noted.     If  there  is  a  trend  of  note 
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(e.g.  Q  decline  in  third-grade  students'  reading  dcores)^  it  lay  be 
vorthvile  to  collect  acre  inforoiation. 

Rssessoents  should  be  adiinistered  early  in  students' *  school 
yearSj  for  t«o  reasons.  (I)  Educators  and  policy  takers  need 
inforaation  on  the  state  of  young  children  to  guide  decisions  about 
early  childhood  education.  (2)  Conteaporary  research  in  child 
developaent  and  learning  has  established  that  subsequent 
achieueaent  in  all  doaains  of  knoaledge  is  heavily  influenced  by 
students*  early  learning  and  experiences  In  and  outside  of 
classrooas.  It  aould  be  helpful  to  understand  the  root  of  a  trend 
to  guide  subsequent  decision  aaking. 

Conclusion 

In  suaj  future  reports  on  Raer lean  education  should  include 
the  foi loving.  (1)  They  should  address  students*  social  and 
coaaun  i  cat  i ve  coapet ence  i  n  odd  i  t  i  on  to  the i  r  ach  i eveaent  i n 
specific  currlcular  areas j  such  as  reading  or  aatheaatics.  (2)  They 
should  include  direct  observation  of  students*  naturally  occurring 
behavior  in  o  variety  of  ciassrooa  situations.  (3)  They  should 
carefully  take  Into  account  differences  aaong  students  that  are  due 
to  cultural  and  eltuational  factorej  and  true  Individual 
differences  oaong  students. 

HCES  should  play  o  strong  role  In  developing  and  odalnisterlng 
a  nee  set  of  osseeeaent  tools  that  aore  adequately  reflect  the 
state  of  Raerlcan  education  at  any  point  In  tiae.  Final lyj  any 
effort  to  chronicle  Raerlcan  education  that  extends  Into  the  next 
century  aust  Include  a  national  coaalttaent  to  support  basic 
research  Into  children's  learning  and  developaent  In  class.^ooas. 
This  le  0  necessary  invest aent  If  ae  are  to  have  the  needed  tools 
in  the  future  to  carry  on  aith  this  iaportant  endeavor. 
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Mr.  Emerson  J.  Elliott,  Administrator 
National  Center  for  Education  Statistics 
•  Brown  Building 
1200  19th  Street,  N.W. 
Washington,  D.C.  20208 

Dear  Mr.  Elliott:  '  , 

'The  American  Association  for  Counseling  and  Develop- 
ment (formerly  the  American  Personnel  and  Guidance  Association) 
is  pleased  to  participate  in  the  redesign  of  the  National  Center 
for  Education  Statistics  elementary  and  secondary  education 
data  program.   There  are  some  important  data  collection/research 
issues  that  should  be  addressed  in  the  future  to  provide 

(  invaluable  information  about  learning  and  the  rules  and  responsi- 

^  bilities  of  school  personnel. 

Rather  than  provide  lengthy  papers  on  these  issues,  we 
have  chosen  to  raise  them  in  this  letter,  with  some  suggestions 
when  possible.   We  would  be  pleased  to.-discuss  them  in  more  de- 
tail with  you  and  to  devote  staff  and  reader  time  to  your 
redesign  effort. 

Demographic  Data 

In  the  past,  there  have  been  a  number  of  problems  in 
collecting  data  on  noninstructional  personnel.    For  example, 
elementary  school  counselors  often  serve  more  than  one  school, 
making  it  possible,  perhaps  even  likely,  that  the  same  person 
is  counted  more  than  once.   This  problem  is  true  of  nursss, 
social  workers  and  others  as  well.    It  is  essential  that  the 
number  of  noninstructional  personnel  be  reported  on  a  district 
basis  in  terms  of  full-time  equivalent  units.    It  would  also  be 
valuable  to  know  what  th^  ratio  of  students  to  these  different 
personnel  is  in  each  district.    Because  the  quality  of  services 
provided  to  students  rests  upon  the  caliber  of  instruction  as 
well  as  the  types  and  extent  of  student  needs  that  are  met,  it 
is  essential  to  assess  accurately  the  number  and  types  of 
noninstructional  personnel  who  provide  services  to  students. 
AACD  worked  collaboratively  with  NCES  In  the  preparation  of 
(  Counselors  in  Local  Education  Agencies,  Fall  1979  and  Trends 

^  S^nce  1970  (NCES  82- 122b).    We  welcome  the  opportunity  to 

participate  in  the  updating  of  this  research  report. 
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Time  and  Task  Analysis 

Recent  studies  on  how  teachers  and  students  spend 
their  classroom  time  have  not  only  been  instructive  in  under- 
standing what  Is  happening  in  the  classroom  but  have  led  educators 
to  reassess  how  they  spend  their  time.    Similar  studies  for  non- 
instructional  personnel  would  be  invaluable  in  assessing  the 
types  of  services  provided  and  the  actual  needs  of  students  and 
faculty.    Educators  at  all  levels  could  use  this  information  to: 

1.  Gain  a  better  understanding  of  the  roles  of  nonin- 
structional  personnel*  including  (but  not  limited  to)  school 
counselors,  psychologists,  social  workers,  nurses,  speech  and 
hearing  specialists,  librarians  and  media  specialists,  adminis- 
trators and  supervisors; 

2.  Assess  student  needs  and  the  degree  to  which  they 
are  being  met  by  nonlnstructlonal  personnel; 

3.  Review  and.  If  necessary,  reformulate  the  roles 
anu  responsibilities  of  nonlnstructlonal  personnel;  and 

4.  Develop  a  comprehensive  approach  based  on  reali- 
ties, not  perceptions,  of  the  appropriate  tasks  of  all  school 
personnel. 

Note:   AACD  Is  extremely  Interested  In  and  willing  to  assist  In 
an/  time  and  task  studies  directed  to  the  study  of  the 
school  counselor's  role  In  elementary  and  secondary 
education. 

Demographic  Data  on  Educational  Personnel 

Information  on  education  personnel,  their  ages,  years 
of  experiences,  training  and  average  length  of  stay  Is  essential 
If  we  are  to  predict  future  personnel  needs  In  a  more  systematic 
manner.   These  demographic  data  need  to  be  correlated  with 
expected  student  enrollment,  based  on  birth  and  enrollment  sta- 
tistics, to  project  future  personnel  needs.    These  projections 
should  address  the  needs  at  least  5-10  years  In  advance  to 
encourage/discourage  youth  and  adults  frof!!  p-«rsuing  training  as 
educators.   The  projected  teacher  shortage  illustrates  the  Im- 
portance of  such  planning.    Systematic,  accurate  Information  on 
current  personnel  and  future  needs  Is  vital  for  all  education 
personnel  If  we  are  to  lessen  or  prevent  personnel  shortages  or 
surpluses  In  the  future. 
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Note:   AACD  can  assist  NOES  In  assessing  the  status  of  student 
enrollment  In  elementary  and  secondary  counselor  educa- 
tion programs.    The  association  Is  also  committed  to 
gaining  better  supply  and  demand  Information  for  counsel- 
ing and  pupil  services  personnel. 

Career  Development 

-  Because  the  goal  of  education  Is  not  only  to  produce 
an  educated  citizenry  but  also  to  prepare  future  generations  to 
enter  the  work  force/  it  is  essential  that  we  assess  students' 
career  development  needs,  current  activities  of  schools  in  foi;ter- 
ing  career  development  and  what  might  be  done  to  Improve  this 
aspect  of  school  preparation.    Such  an  assessment  would  require 
an  indepth  study,  but  that  fact  should  not  be  a  deterrent  to  It. 
The  future  of  our  children,  our  economy  and  our  country  Is 
Intricately  tied  to  successful  employment  of  future  generations. 

Need  for  NCES  Advisory  Council 

We  strongly  recommend  that  NCES  institute  an  advisory 
council  composed  of  educators  from  diverse  instructional  and 
noninstructional  backgrc  ids,  as  well  as  experts  in  assessment, 
parents  and  students  to  provide  advice  on  future  survey  efforts. 
This  advisory  council  should  be  a  formalized  body,  meeting  to 
offer  advice  and  direction  to  NCES.    Diverse  instructional  and 
noninst'^uctional  personnel  should  be  involved,  regardless  of 
the  survey's  focus,  because  few,  if  any,  research  areas  are 
restricted  to  only  one  type  of  personnel.   This  advisory  council 
should  provide  direction  and  advice  and,  in  some  cases,  be  in- 
volved in  responding  to  the  survey  design,  draft  items  and  the 
method(s)  for  survey  dissemination.   Such  involvement  can  help 
identify  problems  of  overlap,  unclear  questions,  misinterpreta- 
tion of  terminology,  gaps  anH  other  Issues  that  ultimately 
reduce  the  validity  and  reliability  of  the  data  collected. 

Note:  AACD  is  willing  to  identify  staff,  leader  and  profes- 
sional representatives  to  participate  in  such  an  NCES 
advisory  council. 

Assessing  School  Counseling 

To  support  the  belief  that  the  Department  and  AACD 
should  work  in  conjunction  with  each  other,  we  have  enclosed  a 
list  of  research  questions  for  assessing  school  cours*»ling  that 
we  submitted  in  the  fall  of  1984  to  the  National  Institute  of 
Education  as  they  formulated  their  priorities  for  the  national 
center  and  laboratory  competition.    While  these  questions  take 
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a  more  indepth  look  at  research  issues  related  to  school  counsel- 
ing, we  think  you  might  find  them  of  value  as  you  address  specific 
questions  related  to  school  counseling. 

AACD  stands  ready  to  assist  NCES  as  the  center  studies 
and  develops  ideas  for  collecting  elementary  and  secondary  educa- 
tion data.   We  can  identify  professionals  who  have  the  expertise 
you  require  as  you  look  broadly  at  the  education  services  we  are 
currently  providing  and  those  we  should  be  providing  in  the 
future.   We  welcome  the  opportunity  to  provide  additional  infor- 
mation or  to  answer  any  questions  about  our  suggestions.  We 
wish  to  be  involved  in  future  efforts. 

Sincerely  yours. 


Patrick  J.  McDbruiugh,  Ed.D.,  NCC 
Executive  Dirac/or 


FEB:LH 
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RESEARCH  QUESTIONS  FOR  ASSESSING  SCHOOL  COUNSELING 
,  U's'ho"?:*^""*^  P"9ra.S 

(c)  survey  opihions  of  various  consumers  about  the  quality  of 
counseling  services  being  delivered  and  their  perce  ved 
needs  for  counseling  services;  and 
•    (d)  assess  what  school  counselors  do  most  effectively. 

What  is  the  impact  of  counselors'  primary  prevention  effnrtc? 
Examples  of  such  programs  include  career^d^cn?onrrela??o;ship 
enhancement,  parent  and  teacher  effectiveness  training  See? 

^'     cenJs'be^S^Shf  ^"'hf  ^«;^'^^°?-'"«king?  Can  children/adoles- 

hfin      4  effective  decisionmakers?  Does  such  traininq 

£2"  children/adolescents  be  taught  effective  probl em-sol vina  skills? 
?hLV.H?f^  most  effective  ways  to  do  so?  A^e  th^  IS  e  to  apj  y 
lSp"ct^'J^;;ef?  ??v%°^'^  ''''''  ^-^•-•"S  have  an  iS?i?tant 

^*     Si'^ll!  ^''^  '•elationship  of  temperament  style  and  characteristics 
\l  nJ[I°"'  «PP'-°aches  of  counseling.  guidaJce  and/or  learning" 

ihVt^un^dr;?%r5?Jafi??Lr  --^^ 

6.     What  are  scne  qf  the  problems  with  cross-cultural  counseling  and  how 
can  they  be  overcome?   What  counseling  techniques  work  best  wi!h 
different  types  of  students  (e.g..  minorities.  5isXn?agedre?c.) 


637 

ERIC  Association  for  Counseling  and  Development  is  Committed  to  Equal  Opportunity 


( 


Comments  for  the 
National  Center  for  Education  Statistics 
Redesign  of  the  Elementary  and  Secondary  Education  Data  Program 

June  14,  1985 


From  the 

American  Association  of  Colleges  for  Teacher  Education 


Prepared  by 

Elizabeth  A.  Ashburn,  AACTE  Director  of  Research  and  Information 
Services 

( 

Edward  Ducharme,  Chair,  Organizational  Counseling  and  Foundations 

Studies,  University  of  Vermont;  Member,  AACTE  Task  Force  on  Research 
and  Information 

Kenneth  Howey,  Associate  Dean  and  Professor,  College  of  Education, 
University  of  Minnesota;  Member,  AACTE  Task  Force  on  Research  and 
Information 

David  G.  Imig,  AACTE  Executive  Director 

David  C.  Smith,  Dean,  College  of  Education,  University  of  Florida; 
AACTE  Immediate  Past  President  and  Member,  AACTE  Task  Force  on 
Research  and  Information 

Sam  J.  Yarger,  Dean,  School  of  Education,  University  of  Wisconsin- 
Milwaukee;  Chair,  AACTE  Task  Force  on  Research  and  Information 

Nancy  L.  Zimpher,  Professor,  The  Ohio  State  University;  Member, 
AACTE  Task  Force  on  Research  and  Information 
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AACTE  gathers  data  about  higher  education-based  teacher  education;  consequently  ^ 
AACTE  does  not  consider  itself  expert  in  the  area  of  data  collection  concerning 
elementary  or  secondary  education.    Our  membership  has  been  involved,  however,  with  a 
variety  of  data  collection  vehicles  sponsored  by  the  National  Center  for  Education 
Statistics.    On  the  basis  of  this  involvement  and  the  Association's  data-collection 
efforts  in  another  sector,  the  following  comments  and  observations  are  offered - 

General  Areas  of  Data  Needs 

In  examining  the  documents  distributed  by  NCES  in  this  call  for  comment,  and  taking 
into  consideration  some  long-term  data  needs  of  the  teacher  education  community,  we  have 
identified  four  areas  which  should  have  a  high  priority  for  NCES: 

o  Teacher  supply  and  demand.    With  increasing  competition  for  scarce  resources  at 
both  the  preservice  teacher  education  and  inservice  levels,  it  becomes  imperative 
to  have  accurate  current  information  on  ?  A  future  projections  of  teacher  supply 
and  demand.    Such  scarce  resources  need  to  be  distributed  so  that  teacher  education 
programs  can  be  responsive  to  the  school  personnel  needs  of  local  districts. 
Information  on  the  teacher  reserve  pool  (its  size,  mobility,  and  interest  in 
returning  to  teaching),  the  retirement  picture  for  the  current  workforce,  accurate 
attrition  figures,  aiid  "lateral  entry"  forecasts  are  needed  both  short-term  and 
long-term. 

o  Beginning  teacher  induction  programs  and  inservice  education.  . Data  about  programs 
in  these  areas  are  cr-tical  because  they  have  implications  for  future  program 
development.    Estimates  as  to  growth  (or  lack  thereof)  of  inservice  and  beginning 
teacher  induction  programs  for  teachers  will  allow  teache^  educators  to  prepare  j 
intelligently  to  assist  school  districts  with  the  continuing  education  of  teachers. 
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o  Data  about  teacher  testing  programs.    To  a  large  degree,  the  credibility  or  teacher 
preparation  institutions  i*  on  the  line  with  teacher  tests.    Despite  the  perceived 
inadequacies  of  the  current  tests,  the  quality  of  schools,  colleges  and  departments 
of  education  is  likely  to  be  judged  based  on  a  variety  of  competency  tests.  If 
support  for  rigorous  and  demanding  tests  can  be  demonstrated,  a  "professional 
school  mentality"  may  start  to  develop.    In  other  professions,  e.g.,  accounting  and 
law,  it  is  normal  for  30,  40,  or  even  50%  of  the  applicants  to  not  pass  the  test  on 
the  first  attempt;  despite  theoe  passage  rates,  the  training  institutions  are 
rarely  blamed.    The  relationship  in  those  circumstances  i:;  between  the  testing 
agency  and  the  prospective  professional.    Typically,  the  training  institution  will 
offer  programs  to  help  students  who  are  having  trouble  passing  those  tests  prepare 
to  do  better  on  the  next  try.    A  similar  attitude  with  respect  to  the  teaching 
profession  is  necessary  and  desirable.    The  more  information  that  can  be  obtained 
on  teacher  testing  programs,  the  better  teacher  education  programs  will  be  able  to 

I 

prepare  to  meet  the  needs  of  teachers  in  this  regard. 

o  Continuity  of  data  gathering.    We  emphasize  strongly  that  most  of  our 

recommendations  for  data-gathering  will  have  little  consequence  if  data  are  not 
gathered  on  a  continuing  and  systematic  basis  over  long  periods  of  time. 
Frequently,  what  is  needed  is  trend  data,  not  i:. dividual  data  for  a  givi»n  year, 
since  of  overwhelming  concern  to  the  education  community  is  continuing  quality  and 
meeting  future  education  needs  with  present  teacher  preparation. 

Sources  of  Data 

NCES  gathers  and  organizes  data  in  three  principal  ways,  according  to  attachment  B 
of  the  information  provided  in  your  request  to  us.    First,  a  variety  of  data-gathering 
^       arrangements  are  in  place  in  state  education  agencies.    Second,  the  Center  sponsors 
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voluntary  response  to  sample  surveys  conducted  by  mail.    Finally,  NCSS  gathers  data 
collected  by  other  federal  agencies.    We  have  two  general  comments  about  these 
approaches  to  data  collection. 

Voluntary  Mail  Surveys.    Cur  observation  of  and  experience  wit"^        ^  collection  in 
schools  of  education  causes  some  concern  regarding  voluntary  response  to  sample  surveys 
by  mail.    We  assume,  for  example,  that  some,  if  not  all,  of  the  data  concerning  teacher 
supply  are  gathered  from  the  complex  questionnaires  that  cU'e  sent  to  selected  registrars 
in  colleges  and  universities  around  the  country.    Typically,  these  are  passed  on  to 
deans  of  education  for  response.    Unfortunately,  many  of  the  items  requesting  specific 
information  require  a  response  that  is  often  too  detailed  and  too  complex  for  the 
respondent.    Consequently,  the  questionnaires  may  be  discarded,  or  more  significantly, 
estimates  may  be  fabricated  for  the  purpose  of  appearing  to  be  in  compliance  with  the 
request.    Therefore,  we  conclude  t^at,  given  our  experience,  much  of  the  data  are 
suspect. 

We  recommend  that  NCES  develop  a  data-gathering  strategy  that  brings  the  Center 
into  closer  and  more  intimate  contact  with  the  potential  respondent  through  reliance  on 
professional  associations.    Recognizing  that  this  strategy  ran  be  very  costly,  it  would 
be  more  acceptable  to  allow  a  higher  margin  of  error  than  to  leave  questions  of  accuracy 
unanswered.    Within  the  constraint  of  scarce  resources,  the  Center  should  focus  on  the 
selection  of  a  smaller  sample  and  take  the  steps  necessary  to  enlist  institutional 
support  dnd  involvement  with  the  data-gathering  strategy.    More  than  likely,  this  would 
require  personal  contact  by  either  a  contractor  or  Center  staff,  but  we  believe  that 
such  contact  is  necessary  in  order  to  ensure  the  necessary  respondent  involvement.  Even 
though  the  error  margin  might  be  larger  than  the  ideal,  the  representativeness  of  the 
data  is  likely  to  be  more  powerful. 
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Collaboration.    The  document  "Indicators  of  Education  Status  and  Trends"  (January 
1985)  lists  the  variety  of  other  federal  agencies  and  departments  with  which  the  Center 
works  in  the  development  of  data-gathering  strategies.    Such  efforts  are  to  be 
applauded,  since  the  richness  of  the  information  is  undoubtedly  enhanced  by  it.  There 
was  no  mention,  however,  about  collaboration  with  and  use  cf  data  and  information  from 
the  broad  variety  of  non-federal  .sources.    In  the  area  of  elementary  and  secondary 
education,  for  example,  such  organizations  as  the  National  Education  Association,  the 
American  Federation  of  Teachers,  the  Council  of  Chief  State  School  Officers,  the 
National  Association  of  Secondary  School  Principals,  and  the  American  Association  of 
School  Administrators,  as  well  as  others,  are  continually  gathering  information  about 
their  enterprises.    We  recommend  that  the  Center  initiate  long-term  collaborative 
relationships  with  these  groups  that  would  allow  for  an  outlet  for  the  important  data 
which  they  collect,  and  also  ultimately  an  increasing  standardization  of  data  that  are 
collected  by  them.    With  the  professional  expertise  euid  the  broad-based  access  to  data 
needs  that  NC£S  possesses,  it  could  be  helpful  in  aiding  organizations  to  focus  their 
limited  data-gathering  strategies.    This  influence  would  lead  to  a  richer  national  data 
pool  that  would  provide  practitioners  with  more,  and  more  accurate,  information,  and 
would  also  help  reduce  the  number  of  problems  that  are  encountered  when  one  set  of  data 
appears  to  be  contradicting  another  set.    We  offer  no  master  plan  concerning  how  these 
long-term  collaborative  relationships  might  evolve,  but  we  remain  convinced  that  such 
efforts  would  be  worthwhile. 
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Obviously,  the  same  idea  concerning  collaborative  relationships  can  and  should 
apply  to  the  gathering  of  data  beyond  the  elementary  and  secondary  education  program. 
These  types  of  relationships  could  also  be  developed  in  the  areas  of  post-secondary 
education,  vocational  education,  and  education  of  a  variety  of  special  programs  and 
populations  that  are  of  interest  to  NCES  and  to  America's  educators. 
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Current  NCES  Data-Gathering  Efforts 


Three  aspects  of  the  current  elementary  and  secondary  program  of  particular  concern 
to  teacher  education  are  discussed  bexow  in  detail.    With  respect  to  the  State  Aggregate 
Fiscal  Report  and  the  Public  School  Survey,  we  believe  that  additional  useful 
information  could  be  obtained  via  these  instruments  than  is  currently  being  collected. 
With  respect  to  the  Survey  of  Teacher  Demand  and  Shortage,  a  revised  data-collection 
methodology  is  suggested. 

State  Aggregate  Fiscal  Report.    NCES  is  committed  to  gathering  state  aggregate 
fiscal  data  concerning  current  expenditures  by  major  function.    Suggested  examples  are 
instruction,  support  services,  and  non-instructional  services;  it  is  unclear  whether 
there  are  more  categories  than  those.    A  category  system  should  be  added  that  allows 
data  to  be  gathered  concerning  the  state  aggregate  commitment  to  teacher  educavion. 
This  could  include  expenditures  for  inservice  education,  beginning  teacher  induction 
programs,  and  support  for  intern  teachers  as  well  as  preservice  teacher  education. 
There  is  precedent  for  public  school  monies  being  used  to  support  all  of  these 
classifications.  • 


Public  School  Survey.    It  is  important  for  the  education  community  to  know  about 
the  nature  of  teacher  training  beyond  preservice  teacher  education.    Do  teachers  take 
college  courses  as  the  primary  strategy  for  inservice  education?    Do  they  enroll 
primarily  in  district-sponsored  inservice  education?-'  Do  they  enroll  primarily  in 
inservice  provided  by  their  teacher  organization  or  by  other  professional  organizations? 
Are  there  more  informal  types  of  inservice  training  that  teachers  use?    In  addition, 
perhaps  througn  the  data  provided  by  the  districts,  it  would  be  helpful  to  find  out  the 
amount  of  mpney  devoted  by  districts  to  inservice  education  as  a  proportion  of  their 
total  budget.    It  is  important  to  know  the  types  of  structures  that  school  districts 
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organize  m  order  to  provide  additional  training  for  teachers.    With  the  current  thrust 
toward  helping  beginning  teachers  adjust  to  the  classroom,  it  is  important  to  start 
gathering  data  about  the  fiscal  support  for  new  teachers  (induction  programs).  Finally, 
it  would  be  very  helpful  if  the  Center  could  develop  strategies  for  gathering  data 
concerning  the  nature  and  frequency  of  relationships  that  local  school  districts  have 
with  institutions  of  higher  education,  focusing  on  inservice  education. 

Survey  of  Teacher  Demand  and  Shortage,    With  regard  to  the  strategy  for  obtaining 
information  on  teacher  demand  and  shortage,  we  reiterate  the  invocation  for  the  more 
intensive  sampling  notion  we  presented  earlier.    In  the  current  plan,  3540  educational 
institutions,  2540  LEAs,  and  1000  private  schools  are  asked  to  provide  information  on 
the  number  of  budgeted  teaching  positions,  number  of  vancancies,  etc.    We  have  two 
concerns  about  this  strategy.    First,  when  over  7000  different  people  are  asked  to 
provide  this  kind  of  information,  the  return  rate  must  be  questioned,  i.e.,  how  many 
people  do,  in  fact,  respond  to  these  surveys?    Second,  the  completeness  and  accuracy  of 
the  information  provided  is  of  concern.    When  questionnaires  come  across  a  respondent's 
desk,  typically  from  sources  toward  which  no  affiliation  is  felt,  the  tendency  is  to 
complete  them  as  quickly  as  possible,  often  with  little  regard  for  the  thoroughness  and 
accuracy  of  the  information  provided.    How  does  the  Center  ensure  these  data  are 
representative?    Requesting  the  same  information  from  a  much  smaller  sample  via  personal 
contact,  such  as  a  phone  interview,  would  al'  w  surveyors  to  quiz  people  and  make 
Judgments  as  to  how  well  prepared  the  respondent  is  to  deal  with  the  question. 

Other  Data-Gathering  Efforts 

Data  needs  that  do  not  appear  to  be  adequately  met  by  the  current  elementary  and 
secondary  program  are  described  below.    Teacher  supply,  teacher  competency,  and  teacher 
career  patterns  are  all  areas  where  NCES  could  be  an  invaluable  source  of  detailed  data. 
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Teacher  Supply,    While  no  reference  was  found  in  tnese  materials  to  teacher  supply, 
and  while  it  may  be  that  the  "supply"  focus  is  part  of  the  postsecondary  program,  it  is 
important  to  mention  it  here.    Currently,  teacher  supply  estimates  are  typically  nade 
from  data  provided  by  institutions  of  higher  education.    More  accurate  sources  of 
teacher  supply  data  are  state  education  departments:    the  number  of  teachers  certified 
and/or  licensed,  the  number  of  emergency  or  provisional  certificates  granted,  the  number 
of  applications  that  were  not  granted  for  one  reason  or  another,  and  the  number  of 
requests  from  school  superintendents  for  special  consideration  in  employing  education 
professionals.    State  education  department  licensure  figures,  gathered  over  time,  will 
provide  trend  lines  on  teacher  supply  that  are  much  more  usable  than  the  data  provided 
by  IHEs.    The  reason  for  this  is  that  many  teacher  education  program  graduates  udve  no 
immediate  goal  of  becoming  classroom  teachers,  i.e.,  a  remarkably  constant  number  go  on 
to  graduate  school,  choose  to  stay  out  of  the  job  market  for  reasons  of  marriage  or 
family,  or  find  alternate  employment  that  is  more  appealing  to  them  at  that  moment  than 
teaching.    Another  confounding  phenomenon  is  that  the  number  of  education  degrees 
awarded  does  not  equal  the  number  of  students  newly  certified  to  teach.  Secondary 
education  teacher  candidates,  for  example,  may  have  a  degree  in  their  subject  area  major 
rather  than  in  education,  and  prior  graduates  can  return  for  postgraduate  work  to  obtain 
a  teaching  certificate.    Thus,  the  number  of  undergraduate  degrees  awarded  from  a 
school,  college,  or  department  of  education  gives  only  that—an  estimate  of  the  number 
of  people  who  have  undergraduate  education  degrees;  this  number  may  be  quite  different, 
across  states  and  across  institutions,  from  the  number  of  those  who  are  actually 
available  to  teach.    We  recommend  that  NCES  take  an  active  role  in  collecting  data  about 
teacher  supply  at  the  state  level. 

Teacher  Testing.    NCES  has  a  significant  role  to  play  in  gathering  data  about  the 
rapidly  growing  teacher  testing  movement  in  American  education.    It  is  important  for  the  j 
education  community  to  know  which  tests  are  used  and  the  frequency  of  their  use. 


Althoug^i  not  necessarily  NCES's  responsibility,  there  should  be  data  provided  conce-^ning 
^        the  validity  and  reliability  of  these  tests.    To  the  extent  possible,  aggregate  scores 
by  region,  type  of  teacher,  etc.,  should  be  rndde  available.    Data  are  needed  concerning 
the  relationship  of  teacher  testing  scores  to  job  placement.    It  is  also  important  to 
discover  the  level  of  discrimination  that  tests  "promote,  i.e.,  do  all  teachers  who  take 
the  te:5t  end  up  passing  it  or  are  some  actually  barred  entrance  to  the  p^^ofession?  He 
recommend  that  NCES  develop  data-gathering  strategies  to  address  questions  of  the  impact 
of  teacher  testing,  in  such  areas  as  the  competence  of  beginning  and  re-entry  teachers, 
recruitment  and  retention  of  minority  teachers,  and  the  overall  quality  of  education. 
Although  some  of  thet'e  questions  may  go  beyond  the  mission  of  NCES,  we  believe  it  is 
important  that  the  questions  be  con,?idered  as  an  important  context  for  development  of 
longitudinal  data  collection  efforts. 

Ce 'Mf ication  and  Licensure.    More  information  is  needed  about  certification  and 
^        licensure  requirements  in  the  states.    It  is  very  difficult,  at  the  current  time,  to  - 
know  whether  a  license  or  certificate  in  one  state  has  any  relationship  to  that  offered 
in  another  state.    Reciprocity  is  Decreasing,  partly  bee  use  of  differences  in  testing 
programs  among  the  various  states  and  partly  because  of  growing  skepticism  about  program 
approval  and  program  quality.    More  intensive  analyses  are  needed  of  what  stands  behind 
certification  and  licensure  requirements  both  across  and  within  the  various  states. 

We  recommend  that  NCES  play  a  significant  role  in  gathering  data  to  increase  our 
understanding  of  the  process  of  certification  and  licensure,  a  process  which  'greatly 
affects  the  country's  supply  of  teachers.    Cooperation  with  the  National  Association  of 
State  Directors  of  Teacher  Education  and  Certification  could  produce  a  ready  supply  of 
such  data. 
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3e;;^inning  Teachers.    Specific  information  from  first-  and  perhaps  second-year 
teachers  over  a  ten-year  period  would  be  very  useful  for  planning  purposes.  Knowledge 
about  their  route  of  entry — traditional  preservice  program,  alternate  program,  lateral 
entry,  and  the  type  of  certificate  he**  d — would  bt  enormously  helpful  to  policy  makers. 
The  type  of  support  available  to  them  as  they  began  their  teaching  careers  and 
information  concerning  experiences  encountered  in  searching  for  a  first  teaching  job  are 
specific  questions  of  concern:    How  many  districts  did  they  apply  to?    How  many 
interviews  did  they  roceive?    How  many  job  offers  did  they  receive?    How  far  away  from 
their  home  or  college  did  they  have  to  go  to  find  a  position?    How  far  away  from  their 
first  choice  did  they  have  to  go?    The  recent  spate  of  literature  concerning  the 
importance  of  the  first  two  years  of  teaching  to  a  teacher's  career  adds  validity  to 
these  questions. 

Teacher  Development.  •  By  virtue  of  the  current  line  of  thought  that  tea  ^ers  go 
through  a  variety  of  developmental  phases,  we  recommend  that  the  National  Center  for 
Education  Statistics  gather  demographic,  inservice  education,  and  other  data  from 
teachers  within  the  framework  of  their  years  of  service.    Such  longitudinal  data  would 
help  to  answer  important  questions  about  degree  of  teacher  retention,  reasons  for 
leaving  teaching,  reasons  for  remaining  in  teaching,  development  of  professional 
competence,  and  impact  of  state  and  federal  education  initiatives  in  this  area. 

Career  Ladders/Lattices.    Information  about  career  options  within  the  teaching 
ranks  for  teachers  is  important,  given  the  strong  movement  in  elementary  and  secondary 
school  systems  to  provide  more  variety  and  reward  in  teachers'  work.    Typically,  these 
are  referred  to  as  career  ladders  or  career  lattices.    The  education  connunity  needs  to 
know  what  is  being  done  across  states  and  what  is  the  impact  of  these  programs  on 
teacher  satisfaction,  teacher  retention,  and  the  development  of  teacher  competence. 
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Teacher  Retention,    The  question  of  teacher  retention  has  awakened  considerable 

interest  over  the  last  five  years.    Although  it  may  be  possible,  in  a  post  hoc  manner, 

to  analyze  some  of  the  data  gathered  by  NCSS  on  this  topic,  it  is  crucial  to  insure  that 

we  have  accurate  answers  to  such  questions  as:    How  long  do  teachers  stay  in  the 

f 

teaching  ranks?    What  are  the  reasons  that  prompt  them  to  leave?    What  proportion  of 
teachers  opt  or  will  opt  for  early  retirement  programs?    What  number  leave  and  return  at 
later  stages  of  their  lives?    We  recommend  that  NCES  make  this  a  focus  for  the  data 
collection  program. 

Early  Retirement.    Another  specific  category  of  teacher  demand  data  that  would  be 
useful  concerns  the  prevalence  of  early  retirement  systems  in  schools  and  estimates  of  , 
what  proportion  of  teachers  are  trking  advantage  of  early  retirement  programs.  A 
retirement  age  of  65  can  no  longer  be  assumed;  many  states  and  school  districts  are 
providing  incentives  for  people  to  retire  early  and  the  large  number  of  "baby  boom"  era 
teachers  are  reaching  an  early  retirement  age.    There  would  be  significant  benefits  from 
estimates  of  future  vacancies  as  well  as  from  the  data  that  the  Center  obtains 
concerning  real  current  vacancies.    This  kind  of  information  would  enhance  the  ability 
of  teacher  educators  to  make  long-term  program  development  decisions. 

Comment  on  "The  Sorry  State  of  Education  Statistics"  by  Cooke.  Ginsburg<  and  Smith 

Cooke,  Glnsburg  and  Sznlth  state  that  education  statistics  as  collected  and 
published  in  the  U.S.  today  are  Inadequate ,  inconsistent i  Incomparable ,  and  sometimes 
just  plain  wrong.    They  advocate  a  set  of  "indicators"  which  would  standardize 
definitions,  collection  parameters,  and  interpretations  across  state  lines.    While  this 
is  a  neat  theoretical  solution,  there  are  serious  problems  when  it  comes  to  application. 
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It  appears  that  the  authors  ai  e  highlighting  a  problem  that  is  not  necessarily 
related  to  "bad"  data  collection,  but  to  uncoordinated  and  non-structured  data 
collection.    Frequently,  those  who  wish  to  make  points  using  data  from  a  varie^^y  of 
sources  are  not  sufficiently  careful  to  document  the  shortcomings  of  the  information 
and,  just  as  frequently,  they  misinterpret  the  data  by  being  insufficiently  specific 
about  tl;?  definitions.    In  one  example,  the  New  Jersey  and  Virginia  vocational  education 
enrollment  problem  cited  in  the  paper  is  obviously  a  case  where  the  count  is  of 
headcounts  of  students  in  classes,  not  number  of  people  enrolled  in  vocational 
education.    If  that  is  made  clear ,  the  data  make  sense,  though  they  might  not  be 
helpful.    In  another  example,  the  problem  presented  by  the  authors  in  understanding 
dropout  rates  appecu:'3  to  be  a  situation  where  the  term  "dropout"  was  probably  defined 
differently  by  the  census  gatherers  and  by  the  school  people.    The  authors  point  out 
reasons  why  people  might  intenticnally  falsify  data,  and  that  might  be  true,  but  the 
differences  are  more  likely  related  to  lack  of  definitional  consistency. 

Cooke,  Ginsburg  and  Smith  propose  common  definitions  of  indicators  across  states. 
W^j  would  agree  with  that,  but  only  to  the  extent  tnat  that  would  allow  either  a  state  or 
NCES  to  have  a  standard  by  which  to  compare  state  data.    Thus,  when  a  state  chooses  to 
gather  data  in  a  different  way,  or  chooses  to  gather  very  limited  amounts  of  data,  the 
statement  could  be  made,  "Their  data  do  not  fit  these  indicators,  thus  we  cannot  use 
them."    In  that  way  Secretary  Bell's  chart  would  have  omitted  the  states  of  Wisconsin, 
Iowa,  and  perhaps  others,  because  so  few  children  took  the  SAT  or  the  ACT  in  those 
states. 

The  paper  points  out  that  we're  a  very  independent  and  autonomous  country  and  we 
gather  data  in  a  variety  of  different  ways.    What  the  authors  seem  to  be  asking  for  is 
some  system  that  will  standardize  the  way  terms  are  defined  and  data  are  collected. 
AACTE  would  submit  that  that  is  close  to  the  collabc  ative  relationship  we  have 
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suggested.    It  would  be  unrealistic,  however,  as  well  an  inappropriate,  to  suggest  that 
everyone  collect  data  in  a  form  determined  by  NCES.    Rather,  it  is  likely  .that  there 
will  have  to  be  careful  separation  of  data  with  definitions  different  from  those  which 
the  Center  can  certify  as  being  standaird  and  comparable.    It  would  also  be  helpful  for 
the  Center  to  offer  a  data-gathering  methodology  critique  service  where  they  will  read 
over  any  state's  (or  other  entity's)  plan  for  gathering  information  and  offer  advice 
about  improvement.    This  strategy  would  be  even  more  helpful  if  the  Center  could  provide 
resources  to  help  states  formulate  better  data-gathering  methods. 

Summary 

The  following  statements  summarize  our  recommendations  for  the  NCES  ten-year  plan 
for  data-gathering  from  the  elementary  and  secondary  education  sectors: 

1.  The  priority  data  needs  of  the  teacher  education  community  are  for  information  in 
four  areas:    (1)  teacher  supply  and  demand;  (2)  beginning  teacher  induction  programs 
and  inservice  education;  (3)  teacher  testing;  and  (4)  continuity  of  data-gathering. 

2.  Collaborative  relationships  need  to  be  established  with  professional  associations 
and  other  groups  with  knowledge  about  the  population  being  studied ,  and  these 
relationshiDS  should  be  ongoing. 

3*    Current  NCES  data-gathering  efforts  should  be  broadened  to  include  the  areas  of 
finamcial  commitment  to  teacher  education  and  the  nature  of  inservice  education. 

4.    The  research  design  of  very  large  samples  should  be  modified  to  insure  completeness 
and  accuracy  of  responses. 


6S1  663 


5.    Data  should  be  collected  on  a  continuing  and  systematic  basis  0\^er  long  periods  of 


time. 

6.    Additional  categories  for  data  collection  should  include:     (1)  teacher  supply  data 
at  the  state  level;  (2)  the  impact  of  teacher  testing  on  recruitment,  retention,  and 
educational  quality;  (3)  the  nature  of  certification  and  licensure;  (4)  the 
experience  of  beginning  teachers;  (5)  teacher  development  via  analysis  by  years  of 
service;  (6)  the  prevalence  and  nature  of  career  ladders;  (7)  teacher  retention;  and 
(8)  early  retirement. 
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AMERICAN  LIBRARY  ASSOCIATION 

50  EAST  HURON  STREET   •  CHICAGO.  ILLINOIS  606n   '  (3»2)   944  67aO 


'l 

0CU 

October  3,  1985 


Emerson  Elliott, 
Administrator 

National  Center  for  Education  Statistics 
1200  19th  Street,  N.W. 
Washington,  DC.  20208-1401 

Dear  Emerson  Elliott: 

Please  forgive  ALA  for  not  responding  earlier  to  your  letter  of  May  17,  1985 
addressed  to  Robert  Wedgeworth.    Mr.  Wedgeworth  left  ALA  in  August  to  become 
Dean  of  the  College  of  Library  Science  at  Columbia  University,    During  the 
last  few  months  a  number  of  important  things  were  neglected,  your  letter  among 
them.    We  sincerely  regret  that  ALA  has  not  taken  part  in  the  redesign  of  the 
NCES,  data  collection  program  for  elementary  and  secondary  education. 

As  you  know  ALA  has  been  working  actively  with  NCE5  to  improve  the  collection 
{  and  publication  of  statistics  about  libraries.    Our  Office  for  Research 

completed  a  contract  for  NCES  In  November,  1984  with  a  report  entitled 
"Analysis  of  Library  Data  Collection  and  Development  of  Plans  for  the 
Future."    This  report  recommended  revisions  in  the  forms  used  to  collect 
statistics  from  College  and  University  Libraries  and  from  School  Library  Media 
Centers.    We  have  been  pleased  to  learn  that  both  of  those  forms  are  being 
used  this  fall  in  much  needed  surveys.    Robert  Wedgeworth,  ALA  Executive 
Director,  and  Jo  An  Segal,  Executive  Director  of  ALA's  Association  of  College 
and  Research  Libraries  sent  a  letter  to  the  directors  of  all  college  and 
university  libraries  urging  them  to  complete  the  form  promptly  and 
completely.    ALA's  American  Association  of  School  Librarians  Is  eager  to  see 
the  results  of  the  Fall  1985  Survey  of  School  Library  Media  Centers  as  the 
data  will  be  extremely  useful  to  the  committee  engaged  in  drafting  revised 
standards  for  school  library  media  centers.    Finally,  the  ALA  Office  for 
Research  has  just  begun  work  on  i  contract,  funded  jointly  by  NCES  and  the 
Division  of  Library  Programs,  to  conduct  a  pilot  study  leading  to  a 
cooperative  system  for  public  library  data  collection  based  on  annual  data 
collection  by  the  fifty  states. 

As  you  can  see  ALA  Is  very  Involved  in  the  NCES  data  collection  efforts  which 
relate  to  libraries.    School  library  statistics  are  of  special  concern  to  us 
because  there  Is  almost  no  other  source  of  information  on  this  topic.    The  OFR 
report  noted  earlier  documents  the  fact  that  although  some  information  about 
the  other  library  types  Is  available  from  states  and  other  organizations,  this 
is  not  true  for  school  library  statistics.  We  are  very  pleased  that  NCES  is 
surveying  school  library  media  centers  In  Fall,  1985.    The  latest  available 


data  was  collected  in  1978  and  is  no  longer  useful.    We  believe  that 
statistics  about  school  libraries  should  be  an  important  part  of  any 
elementary  and  secondary  school  data  collection  effort.    Data  should  be 
collected  regularly  on  this  topic  and  included  in  the  compilations  which 
describe  other  data  collected  on  education--the  Digest  of  Education  Statistics 
and/or  the  Condition  of  Education. 

We  hope  these  ideas  can  be  incorporated  into  your  plan  even  though  we  have 
missed  your  deadlines.    If  there  is  anything  ALA  can  do  at  this  late  date  to 
provide  additional  information  please  contact  us  through  Dr.  Mary  Jo  Lynch, 
Director  of  the  ALA  Office  for  Research. 


Sincerely  yours 


Roger^Parent, 
Acting  Executive  Director 

cc:  Eileen  Cooke,  Director,  ALA  Washington  Office 
Larry  Lamour,  NCES 

Mary  Jo  Lynch,  Director,  ALA  Office  for  Research 
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LDUCATIONAL  STATISTICS  FOR  STUDIES  OP  POLICY  AND  ADM IN I SI RAT ION 


Robert  G.  Lehnen 
Professor  of  Public  Affairs 
School  of  Public  and  Environmental  Affairs 
Indianapolis,  IN  .46223 

Telephone :  317/264-3466 


(August,  1985) 


an  invited  paper  prepared  for  the  redesign  of  the  elementary 
and  secondary  education  data  program  of  the  United  States 
Department  of  Education,  National  Center  for  Education  Statistics 
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Education  Statistics  for  Studies  of  Policy  and  Administration 


I.  Introduction 

The  observations  contained  in  this  paper  arise  from  the  study 
£iJlAILCjJ13  Indiana's  £iiJbli£  Sfilifl^is  done  in  1984  for  the  Indiana 
General  Assembly^.  The  study  used  data  from  the  National  Center  for 
Education  Statistics  (NCES)  to  compare  Indiana  with  other  states  in 
the  areas  of  resources  committed  to  education  and  in  educational 
performance.  The  difficulties  that  arose  in  making  these  comparisons 
and  the  reactions  o£  the  supporters  and  critics  of  the  study  are 
reported  here.  The  remainder  of  the  paper  addresses  some  specific 
problems  concerning  NCES  statistics  and  practices  and  presents  some 
r:^commendations  for  improving  them. 


II.    Utility  Ql  S£JSi&  Statistics  IsOL  2q11s^  Studies 

A  central  question  facing  most  states  today  concerns  the  adequacy 
of  their  public  education  system^  both  in  the  areas  of  the  resources 
committed  to  education  and  the  performance  of  the  system.  Indiana  is 
no  exception  in  this  regard.  Having  experienced  severe  economic 
hardships  in  many  parts  of  the  state,  Indiana  in  recent  years  has 
taken  a  closer  look  at  its  public  schools  with  the  intent  both  to 
improve  quality  and  also  to  make  the  state  more  competitive  in  its 
ability  to  attract  industry  and  retain  its  workforce. 

Financing  Indiana's  £uJilic  SfilliifllS  was  designed  to  review 
Indiana's  position  among  the  states  and  report  on  the  effects  of 
property  tax  reform,  undertaken  in  1973,  on  its  304  school  districts. 
NCES  statistics  played  a  central  role  in  accomplishing  the  first 
purpose'^,  and  statistical  information  .pn2  from  the  Indiana  Department 
of  Education  provided  the  basis  for  district  by  district  comparisons 
of  the  effects  of  tax  reform*  The  discussion  in  this  section  is 
confined  to  the  role  that  NCES  statistical  information  played  in  the 
Indiana  report* 

Tho  principal  NCES  measures  used  in  the  report  fell  into  two 
categories:  (a)  measures  of  input  (resources)  and  (b)  measures  of 
output  (performance)*  The  report  reviewed  the  availability  of 
education  statistics  that  both  measured,  in  some  general  way,  one  of 
these  two  concepts  and  also  provided  state  by  state  comparisons*  Most 
measures  reported  in  NCES  publications  did  not  meet  these  two 
requirements,  particularly  the  latter  one* 

The  measures  eventually  used  in  the  study  to  compare  Indiana  to 
other  states  are  as  follows: 
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Input  Pleasures 

Average  days  attended  per  pupil  enrolled,  1975-76 
Number  of  pupils  per  teacher;  1980-81 

Number  of  pupils  per  teacher  based  on  enrol Iment,  1980-81 
Total  expenditures  per  pupil 

xotal  public  school  expenditures  as  a  percent  of  personal 
income 


Output  Hi 

Median  years  of  education 

Percent  graduating  from  high  school 

Average  SAT  score  (for  22  states) 


Some  of  these  measures  were  not  ideally  suited  for  the  task*  The 
output  measures  often  were  criticized  as  being  too  vague  and  not 
reflecting  performance.  In  particular^  the  lack  of  suitable  measures 
of  achievement  and  other  aspects  of  educational  performance  limited 
the  effectiveness  of  the  study* 

Among  the  input  measures  Total  Expenditures  per  Pupil  received 
the  most  attention*  A  series  was  constructed  from  data  provided  in 
tables  reported  in  issues  of  the  Digest  of^  Education  Statistics  to 
show  trends  in  national  and  state  expenditures*  This  analysis 
received  considerable  comment  from  General  Assembly  members,  the 
m3diar  and  various  interest  groups*  Those  critical  of  the  conclusions 
of  the  study — that  Indiana  was  substantially  behind  other  states  in 
levels  of  spending  for  public  education  and  was.  falling  further 
behind — argued  that  the  NCES  data  were  unreliable  and  w^.  :e  not 
uniformly  reported  by  the  states*  The  critics  thus  concl;ided  that 
Indiana  was,  in  fact,  better  off  than  what  the  NCES  statistics 
indicated,  and  the  conclusions  of  the  study  laust  therefore  be 
discounted*  These  and  other  issues  in  the  use  of  NCES  statistics  for 
making  policy  recommendations  are  discussed  in  moro  detail  in  the  next 
sections* 


III*    Improving  ths,  ^^iH^Y      S££&  Statistics  In  £all£X  Studies 

performance  Meaauress  One  conclusion  reached  in  doing  the  report 
for  the  General  Assembly  is  that  there  are  few  good  measures  suited 
for  policy  and  administration  studies*  One  can  divide  policy  and 
administration  measures  into  three  categories:  input  or  resource 
measures,  process  or  admini  strati  on  iraasures,  and  outcome  or 
performance  measures*  Although  some  measures  reported  in  the  Digest 
pf  Education  Statistics  may  be  Suitable  to  use  for  one  of  these  three 
puiposesr  most  fail  on  other  accounts  discussed  below* 

The  area  where  most  attention  is  needed  is  on  the  performance 
side*  The  question  most  asked  by  Indiana  General  Assembly  members  was 
about  the  effects  obtained  from  various  programs  and  expenditures* 
Bow  can  one  know  that  if  spending  is  raised^  or  class  size  reduced, 
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that  the  schools  will  produce  a  better  educational  product?  The  three 
output  measures  used  in  the  Indiana  policy  study  were  poorly  suited  to 
evaluate  the  performance  of  the  Indiana  educational  system  as  a  whole, 
and  thus  anecdotal  information  received  as  much  credibility  at  times 
as  national  statistics. 


LfLaa  Aagreqation!     The  current  measures  of  education  (input, 
process,  or  output)  are  not  very  useful  because  of  their  present  level 
of  aggregation.     National  averages  and  other  statistics  do  not  reveal 
much  about  the  state  education  systems.    Since  education  is  primarily 
a  local  and  state  function,     it  is  essential  to  disaggregate  the 
information  to  state  and  district  levels.    Without  this  detail  NCES 
data  will  have  only  limited  utility  for  policy  studies  within  states. 
Yet  it  is  the  states  who  will  determine  the  direction  and  scope  of 
education  policy  and  not  the  federal  government.    Without  this  detail 
NCES  data  will  have  only  limited  utility  for  policy  studies  among  or 
within  states. 

£flnipaxa]2ilitxs  it  should  be  possible  to  obtain  uniform 
information  about  every  school  district  in  the  nation.  Since  most 
states  including  Indiana  have  their  own  departments  for  recording 
state  and  district  level  education  statistics,  one  may  argue  that  the 
state  is  the  proper  place  to  maintain  such  detail.  If  the  states  are 
to  become  the  repository  of  state  and  district  information,  then  the 
measures  reported  by  the  states  and  NCES  must  be  the  same.  In  the 
course  of  the  Indiana  school  finance  study,  it  was  not  possible  to 
construct  district-level  measures  of  "national"  statistics  even  though 
the  information  had  come  from  Indiana.  For  example,  the  measure  Total 
Expenditures  per  Pupil  reported  by  NCES  was  not  available  by  district 
in  Indiana. 

LA£Jl  2l  Dflgjimfintal;l611  s  There  appears  to  be  no  technical 
publication  reporting  NCES  operational  definitions,  technical  terms, 
standards,  practices,  and  quality  control.  Early  in  the  Indiana 
school  finance  study,  a  reference  librarian  at  Indiana  University 
attempted  to  obtain  such  a  document  without  success.  Subsequent  calls 
to  NCES  and  a  conversation  with  a  staff  member  revealed  that  no  such 
publication  presently  exists.  The  lack  of  such  documentation  makes  it 
impossible  to  provide  information  about  the  interpretation  of  the 
statistical  information.  Furthermore,  it  compromises  the  conclusions 
reached  by  analysts  using  NCES  data,  because  critics  often  use 
anecdotal  or  hearsay  information  to  refute  conclusions.  For  example, 
critics  of  the  Indiana  study  charged  that  Indiana's  average 
expenditure  figure  was  "too  low"  because  book  fees,  paid  for  in 
Indiana  by  parents  and  not  by  tax  monies,  were  not  included  in  the 
Indiana  statistic.  This  observation  could  never  be  verified  or 
refuted. 


Me^ia  ;fQr  Reporting!  The  eight  NCES  measures  used  in  the  Indiana 
study  came  from  the  following  sources:  key  punching  of  selected 
tabular  information  from  various  Issues  of  the  Digest  q±  Education 
Statistics,  and  key  punching  of  a  table  reported  in  USh  Isidax  from  the 
January  6,  1984,  news  conference  by  Secretary  of  Education  Terrell 
Bell.  The  latter  source  was  subsequently  verified  six  mouths  later  by 
obtaining  a  copy    of  the  press  release  prepared  by  the  Department. 
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Several  comments  are  in  order  regarding  the  means  by  which  this 
statistical  information  was  obtained.  First,  statistical  series,  such 
as  total  expenditures  per  student,  should  be  identified  as  such  and 
reported  as  a  series.  Presently,  finding  comparable  tables  in  various 
issues  of  the  DiSfifii  appears  to  be  the  only  direct*  method  of 
identifying  series.  Second,  data  should  be  available  through  other 
media  than  press  reports  and  publications.  The  data  released  to  the 
media  during  the  Bell  press  conference  snould  have  been  available  on 
floppy  diskette,  computer  tape,  and  other  such  media.  In  general, 
p j.qegt  issues  should  appear  on  computer  tape  in  a  manner  similar  to 
that  used  by  the  Bureau  of  the  Census  to  report  its  County-City  DAiA 
fiiiJl  information.  With  the  advent  of  the  professional  computer,  data 
should  be  readily  available  on  floppy  diskette  as  well  as  on  public- 
use  tapes." 

As  a  case  in  point,  the  Indiana  Department  of  Education  provided 
its  entire  10-year  database  for  304  school  districts  on  computer  tape 
in  Statistical  Analysis  System  (SAS)  file  format.  Such  assistance 
greatly  facilitated  the  access  to  information  and  the  analysis  of  the 
iL'-^ues.  .  .      ,  *  , 

In  the  next  section  suggestions  are  presented  for  the  improvement 
and/or  expansion  of  educational  statistics.  This  list  is  not  designed 
to  be  comprehensive  but  rather  reflects  the  accumulated  experiences 
and  opinions  of  the  author.  .  , 


IV.     £fime  Specific  Snygest^ions  Concerning  Education 

Bureau  fll  t^P  Census  Data;  The  Bureau  of  the  Census  presently 
provides  data  on  population  and  housing  characteristics  by  school 
district.  This  series  is  a  important  source  of  information  and  should 
be  continued.  Two  observations  pertain  to  the  Indiana  public-use 
tape.  First,  the  release  of  data  should  occur  sooner.  Secondly,  the 
accuracy  of  the  data  needs  to  be  verified.  In  the  latter  s-.tuation, 
the  Indiana  public-use  tape  contained  numerous  errors,  including 
omission  . of  districts  and  the  combination  of  similar-named  districts^ 
and  thus  was  unusable  for  the  study. 

Public  Opinion  Reward  Educations  Several  polling  organizations 
such  as  the  Gallup  Poll  have  conducted  surveys  of  public  attitudes 
toward  education  issues.  Such  surveys  should  be  continued  and 
coordinated  through  NCES.  Specifically,  a  standard  national  survey  of 
opinion  should  be  conducted  through  NCES  at  least  annually  and  a 
series  of  standard  indicators  developed.  In  addition,  NCES  should 
have  a  research  program  whereby  specific  questions  may  be  added  to  the 
core  survey  to  measure  current  issues.  For  example,  the  impact  of 
private  schools  such  as  the  "Christian  academies"  on  public  schools 
could  be  explored*  The  survey  data  should  be  available  n  a  timely 
manner  on  public-use  tape  or  similar  medium.  Competitive  research 
solicitations  should  be  offered  to  select  the  principal  investigator 
for  each  year's  special  subject. 
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Survey  fil  Sfihfiiil  Personnel;  No  doubt  one  of  the  least  documented 
areas  of  education  is  the  state  of  the  education  personnel  systenif  the 
teacher  and  administrative  workforce.  One  reads  about  "burn-out",  \ 
victimizationr  and  disillusionment  among  teachers  and  administratorsr 
but  NCES  provides  little  in  the  way  to  document  these  reports.  An 
annual  survey  of  school  personnel,  including  at  least  teachers  and 
administrators,  is  needed  to  measure  the  conditions  in  the  workforce. 
Some  topics  to  be  included  in  the  survey  are  measures  of  "burnout", 
perceptions  of  working  conditions,  reports  on  use  of  summer  time, 
expectations  about  the  future,  crime  and  victimizatic-n  in  the 
workplace,  out-of-pocket  expenses  incurred  by  faculty,  and 
uncompensated  job-related  duties. 

LaJaOJ:  Relations  Information!  NCES  needs  to  report  on  the  state 
of  labor  relations  in  the  nation's  schools  It  should  provide 
information  on  such  labor-related  characteristics  as  the  degree  and 
type  of  professional  bargaining  units,  the  number  and  duration  of 
strikes,  and  the  time  to  settlement  of  contract  negotions.  These  data 
should  be  available  on  a  district  by  district  basis.  One  question 
that  might  be  ultimately  answered  from  such  data  is  the  relationship 
between  labor  relations  (timely,  amicable  settlement  vs.  strife-ridden 
*:egotions)  and  performance. 

ttealkfci  aniJ  Nutrition!  Many  people  believe  that  the  nutritional 
behavior  of  students,  both  before  school  and  in  the  school  cafeteria, 
is  related  to  discipline  and  other  performance  issues  in  the 
classroom.  School  cafeterias  vary  greatly  in  the  degree  to  which  tl*ey 
offer  nutritionally  balanced  meals  as  contrasted  to  ones  high  in 
carbohydrates  and  "empty  calories".  Some  teachers  have  observed  what  j 
they  believe  to  be  "carbohydrate  highs"  that  may  cause  behavior 
problems  in  afternoon  classes* 

NCESr  possibly  in  cooperation  with  the  Department  of  Health  and 
Human  Services,  should  develop  a  series  of  studies  to  determine  the 
nutritional  value  of  meals  offered  in  school  cafeterias  and  consumed 
by  most  students*'  In  addition,  the  nutritional  education  and  behavior 
of  students  should  be  explored,  including  breakfast-eating  behavior, 
knowledge  of  nutritional  issues,  and  choices  make  in  the  cafeteria, 
and  this  behavior  should  be  related  to  educational  performance  and 
behavior. 

Class  Size  and  Teacher  Load  Informations  The  current  measures  of 
average  class  size  reported  in  the  Digest  qJ^  Education  Statistics  do 
not  provide  sufficient  detail  to  be  of  much  use.  The  averages 
reported  for  Indiana,  foe  example,  in  no  way  reflect  the  personal 
experiences  of  this  author  or  those  of  teachers  he  has  consulted* 
One  general  argument  made  locally  is  that  special  education  clas3es 
skew  the  class  size  distribution  and  distort  the  mean,  thus  giving  the 
impression  of  smaller  than  actual  class  sizes.  NCES  needs  to  develop 
information  on  the  variation  in  class  size  by  distict,  subject,  and 
grade.  An  example  of  class  size  data  is  given  in  Table  1.  Other 
statistical  information  such  as  the  median  class  size  for  each  subject 
and  percentile  information  should  be  developed  from  such  data. 
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TABLE  1 


( 


Example        Qls^  Table 


School  District:  ABC  School  Corporation 
Grade:  7 


Size  o£  Class: 


18 


19 


20 


21 


Median 


Subject  ' 

English 

Mathematics 

Reading 

Science 

Social  Studies 

.  table  entries  are  number  of  classes  of  a  given  size  for 
each  subject 


School  District:    ABC  School  Corporation 
Level:    Middle  School 

Number  of  Students:  120-129      130-139      140-49  •••  Median 


Subject 

English 

Mathematics 

Reading 

Science 

Social  Studies 


teachers  who  teach  part-time  or  more  than  one  subject 


TABLE  2 


Example  Qt  Teachi^r  LfiAd  MeaSUCe 


should  be  pro-rated  on  an  FTE  basis 
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A  related  measure  that  should  be  developed  is  Teacher  Class  Load. 
This  is  a  measure  of  how  many  students  a  teacher  in  a  given  subject 
instructs  each  school  day.  Such  data  should  be  a^'ailable  by  district 
and  subject.  An  example  of  such  data  is  given  in  Table  2»  The  ) 
development  of  the  above  information  should  be  done  for  core  subjects 
initially  and  then  expanded  to      include  the  entire  cirriculum. 

Measure55  pf  Pfr^ormance:  As  indicated  in  the  first  section  of 
this  paperr  NCES  does  not  report  sufficient  measures  of  performance. 
The  general  question  of  what  kinds  measures  to  be  collected  should 
be  explored  with  various  public  interest  groups^  policy  makers^  and 
education  professionals.  Undoubtedly^  some  measures  of  achievement  in 
basic  subjects  are  required^  but  the  measures  should  not  be  confined 
to  achievement  measures.  The  selection  of  measures  to  be  included  in 
NCES  reporting  should  be  done  by  a  public  process  reflecting  the 
contributions  of  many  diverse  groups.  Whatever  measures  are  selected 
should  be  reported  at  least  annually  by  state  and  district.  Without 
such  information  the  nation's  policy  makers  cannot  effectively 
evaluate  the  nation's  schools  and  develop  urograms  to  remedy 
deficiencies. 

£fiiDPAXdJ2lfi  £j(fi£jidi:tux£  H^La.^     The   lack  of 

comparability  between  states  poses  serious  problems  for  understanding 
that  nature  of  school  expenditures  and  revenues.  Although  sufficient 
detail  exists  within  Indiana  for  its  304  school  districts,  attempting 
to  compare  Indiana's  practices  to  otheir  states  is  extremely  difficult 
or  impossible.  NCES  should  take  the  lead  in  developing  a  model  state 
data  base  and  reporting  system  for  district  level  data.  Although  such 
data  may  be  collected  and  maintained  at  the  state  level,  standard 
format  public-use  tapes  from  each  state  should  be  available.  ) 

Expenditure  and  revenue  measures  should  be  the  core  indicators  of 
such  a  system  but  other  measures  such  as  enrollment  and  performance 
measures  should  be  considered  as  well.  The  separate  states  may  take 
responsibility  for  collecting  and  reporting  the  information,  whereas 
NCES  may  report  statistics    of  primarily  national  interest. 


V.    Sm&  Concluding  Observations 

The  present  condition  of  NCES  statistics  severely  limits  their 
utility  for  policy  and  administration  studies.  Although  this  paper 
has  suggested  several  areas  where  Improvement  is  desirable,  it  should 
noted  that  some  recommendations  have  special  priority.  The 
principal  areas  for  improvement  should  concentrate  on  developing  more 
useful  measures  of  education  performance?  producing  less  aggregation 
of  information  by  providing  state  and  district  lev3l  information;  and 
finally  instituting  better  documentation,  quality  control,  and 
distribution  of  the  product.  These  enhancements,  more  than  any  other, 
should  improve  the  condition  of  national  education  statistics. 
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footnotes 


1  Robert  G.  Lehnen  and  Carlyn  E.  Johnson,  Zin^illfiilia  Indianalfi 
£juijli£  Sfihsifllfi:  An  Analysis  the  and  B££fiJDm£ndatijQn£  ts^  th^ 
future,  Indianapolis,  IN:  Indiana  University,  School  of  Public  and 
Environmental  Affairs: (1984) ,  160  pages. 

2  See  "Chapter  4:  Achieving  Quality  Education  in  Indiana:  What 
Level  of  Funding  Is  Required?"  in  Lehnen  and  Johnson,  cp. 
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June  20,  1985 


Mr.  Emerson  J.  Elliott 
Administrator 

National  Center  for  Education  Statistics 
400  Maryland  Ave.  SW 
Washington,  D.C.  20202 


Dear  Mr.  Elliott: 


Thank  you  for  your  letter  to  Mr.  Townsend  Hoopes,  President  of  the 
Association  of  American  Publishers,  Inviting  our  Industry  to  make  suggestions 
for  the  planned  NCES  redesign  of  Its  elementary  and  secondary  data  program. 
The  AAP  views  this  as  an  exciting  opportunity  and  has  asked  our  Research 
Committee  to  respond. 

At  the  June  meeting  of  our  committee,  we  agreed  to  do  this  ^n  stages: 
(a)  by  fUing  with  you,  by  June  21,  1985,  a  written  list  of  suggested  changes 
in  NCES  data  collections  for  your  published  reports;  (b)  informal  discussion 
of  these  suggestions  with  staff  members  of  NCES  during  our  committee  *s 
planned  visit  to  your  offices  on  August  1,  1985;  and  (c)  if  it  appears 
warranted,  to  follow  these  steps  with  further  written  communication  by 
September  30,  1985,  and/or  participation  in  public  hearings,  as  mentioned 
in  your  letter  to  Mr.  Hoopes.    The  following  is  our  committee's  list  of 
suggestions: 

1.    Estimates  of  secondary  school  course  enrollments  are  needed  much 
more  frequently.    By  this  we  mean  the  type  data  NCES  has  supplied 
Summary  of  Offerings  and  Enrollments  in  Public  Secondary  Schools, 
1972-73  (NCES  76-150) >  Conrse  0ffering8>  Enrollments,  ana  curriculum 
Practices  in  Tublic  Secondary  Schools.  1972-73  CNCES  >7-i53) ,  and 
A  Trend  Study  of  High  School  Offerings  and  Enrollments:  1972-73 
and  1981-82  (NCES  84-224) >    This  is  a  critical  data  need.  Such 
market-size  estimates  comprise  one  of  the  most  vital  factors  by 
which  educational  publishers  decide  whether  to  publish  and  how  to 
publish  instructional  materials.    Such  data  every  10  years  is 
clearly  not  frequent  enough.    Dramatic  changes  occur  in  a  decade. 
Elhl  publishers  need  such  data  every  2  ye;irs.    We  submit  that  suf- 
ficiently reliable  data  can  be  collected  through  probability 
samples  at  a  reasonable  expenditure  by  the  Government.  Enrollment 
data  should  cover  Grilles  7-8  as  well  as  Grades  9-12.  Reasonably 
reliable  sub-sample  estimates  should  show  enrollment  variations 
*  for  (a)  course  duration  (full-year,  one  semester,  etc.),  (b) 
geographic  distribution  (state  by  state,  or  perhaps  by  the  nine 
census  regions),  and  (c)  public  vs.  private  schools.    The  raw  numbers 
of  students  enrolled  in  each  course,  plus  their  percent  of  all 
students  in  all  grades,  are  the  key  data  needed. 

Atlanta  /  Dallas  /  Geneva,  Illinois  /  Lawrenceville,  New  Jersey  /  Palo  Alto 
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2.  Estimates  every  two  years  of  elementary  school  enrollments  for  each 
of  the  major  course  areas  are  likewise  a  critical  need.    This  should 
cover  Grades  K-6,  especially  if  you  account  for  Grades  7-8  enrollment 
components  of  K-8  curricula  under  Item  #1  above.    Experts  presume  that 
lOOZ  of  students  are  enrolled  in  Reading  and  Mathematics  in  Grades  K-6. 
However,  as  we  know,  there  is  considerable  variation,  especially  in  the 
lower  grades  (as  well  as  in  Grades  7-8),  in  the  proportions  of  students 
enrolled,  at  each  grade  level,  ^in  other  course  areas  such  as:  English/ 
Language  Arts,  Spelling,  Handwriting,  Science,  Health,  Social  Studies, 
Coiuputer  Sciences,  Music,  Art,  Foreign  Language,  etc.    Yet  there  is 
currently  no  central  data  collection  pinpointing  the  sizeable  variations 
believed  to  exist  in  the  percents  of  students,  grade  by  grade,  who  take 
these  subjects.    This  is  a  serious  data  gap.    The  same  data  specifications 
(especially  concerning  the  duration  and/or  frequency  with  which  such 
courses  are  taught)  —  and  the  same  supporting  arginnents  ~  outlined  in 
Item  #1  above  apply  here. 

3.  Grade  by  grade  projections  of  tofl  enrollments  (of  all  students  in  all 
courses)  for  each  level  K-12  are  a  similar  vital  and  frequent  need  for 
long-range  planning  by  publishers.    Data  should  be  organized  like  Table 
6  in  the  NOES  volume.  Projections  of  Education  Statistics  to  1990-91, 
an  important  annual  doctment.    Past  data  (from  Table  22  In  the  NOES 
annual  Digest  of  Education  Statistics,  another  Important  document)  should 
extend  back  10  years,  and  projected  estimates  should  extend  10  years  into 
the  future.    Such  projections  could  be  delivered  in  both  of  two  frequencies 

(a)  Annually;    Grade  by  grade,  K-12,  for  nationwide  total  enrollments, 
as  well  as  sub-sample  breaks  for  (1)  the  nine  census  regions  and 
(2)  public  vs.  private  schools. 

(b)  Every  2-3  years:    Grade  by  grade,  K-12,  ,for  nationwide  total 
enrollments,  as  well  as  sub-sample  breaks  for  state  by  state. 

4.  The  number  of  units  required  for  high  school  graduation  in  each  of 
the  various  course  areas,  state  by  stats,  are  Important  data  —  needed 
annually. 


5*    The  specific  courses  (and  their  duration)  mandated  in  high  schools, 
state  by  state,  are  similarly  Important  data  —  needed  annually. 

Our  Research  Committee,  Mr.  Elliott,  respectfully  submits  that  the  above 
key  data  needs  will  enhance  decision-making  on  a  broad  basis  throughout  the 
education  community.    More  prudent  decisions  by  publishers,  large  and  small,  as 
represented  by  the  AAP,  lead  to  a  better  choice  of  more  competitive  and  suitable 
instructional  materials  for  all  school  systems* 
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Please  let  either  me  or  Ms.  Barbara  L.  Meyers,  Assistant  Director, 
School  Division,  AAP,  at  its  headquarters  in  New  York  know  whether  it  will  be 
convenient  for  our  Research  Committee  to  discuss  these  and  perhaps  other  issu^j 
with  you  and  NCES  staff  members  at  our  scheduled  meeting  in  your  officer"  August  1 
(as  arranged  by  her  and  Ms.  Kay  McKinney  of  NIE). 


Sincerely, 


  'L.  Re^ce 

Chairman, ^Research  Committee 
School  Division,  AAP 


cc:    Ms.  Barbara  L.  Meyers,  AAP 
Mr.  Donald  Ecklund,  AAP 
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THE  ASSOCIATION  OF  TEACHER  EDUCATORS 


THE  IDENTIFICATION  OF  DATA  NEEDED  TO 
SUPPORT  DELIBERATIONS  ON  POLICY  ISSUES 


Submitted  to  the  National  Center  for  Education 
Statistics  for  consideration  in  the  redesign 
of  its  elementary  and  secondary  education 
data  program. 


Prepared  by  Dr.  Lee  Bartolini 
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T^e  Association  of  Teacher  Educators,  as  an  organization  concerned  about  the 
improvement  of  elementary  and  secondary  education,  is  keenly  interested  in 
the  National  Center  for  Education  Statistics'  plan  to  redesign  a  10  year 
program  for  elementary  and  secondary  data  collection.    The  organization  is 
primarily  interested,  however,  in  data  collection  activities  which  will 
focus  on  the  needs  of  teachers  and  teacher  educators.    In  recent  years,  a 
flood  of  national  and  state  reports  have  identified  the  need  to  improve  the 
quality  of  teaching  as  a  major  educational  issue.    Data  collection 
activities  designed  to  provide  the  information  regarding  this  issue  would  be 
most  beneficial  to  decision  and  policy -makers. 

Some  institutions,  primarily  state  education  agencies,  have  tried  to 
identify  and  collect  data  needed  to  improve  the  quality  of  teaching  and 
teachers.    These  efforts  have  included,  but  have  not  been  restricted  to,  the 
components  of  teacher  training  programs.    Additional  information  useful  to 
decision-makers  includes  local  district  recruitment,  selection,  and 
evaluation  procedures,  and  statewide  teacher  supply  and  demand  statistics. 
These  subjects  are  areas  In  which  new  data  will  be  especially  useful  to 
decision-makers  for  elementary  and  secondary  programs. 

The  Council  of  Chief  State  School  Officers  (CCSSO)  Is  also  Interested  in 
.  knowing  what  states  are  doing  to  improve  the  quality  of  teaching.  A 
committee  of  CCSSO  on  Teacher  Edi:cation  and  School /Col  lege  Collaboration 
recently  initiated  a  50-state  survey  which  attempts  to  Identify  those 
activities- which  have  occurred  or  will  occur  relevant  to  four  policy  areas: 
attracting  persons  to  the  teaching  profession,  preparing  persons  for 
teaching,  licensing  persons  for  the  teaching  profession,  and  retaining 
teachers.   The  CCSSO  survey  also  Includes  a  component  on  teicher  supply  and 
demand.    The  policy  areas  Identified  by  the  CCSSO  and  the  state  education 
agencies  orovlde  a  framework  for  Identifying  data  needs. 

The  NCES  plan  to  redesign  Its  data  collection  activities  focuses  upon 
elementary  and  secondaif7  education.    However,  as  suggested  above,  some  data 
identified  may  be  available  from  or  through  state  education  agencies  or 
regional  levels  of  government.   NCES  may  want  to  consider  these  sources  when 
planning  data  collection  activities.   Another  consideration  Is  that  teacher 
education,  historically,  has  been  a  state  concern.    Therefore,  national  data 
would  be  most  useful  If  It  could  be  generalized  to  specific  states. 

Much  information  needed  to  make  decisions  regarding  teaching  Is  available 
only  through  colleges  and  universities.    Information  on  the  recruitment  and 
selection  of  potential  teacher  candidates  by  Institutions  of  higher 
education.  Information  regarding  the  components  of  teacher  education 
programs,  and  information  concerning  requirements  for  satisfactory 
completion  of  teacher  preparation  programs  are  examples  of  data  needs  which 
greatly  affect  elementary  and  secondary  education,  but  which  must  be 
obtained  through  institutions  of  higher  education.    NCES  also  needs  to 
consider  this  source  in  Its  data  collection  plan. 

Specific  types  of  lata  relevant  to  the  improvement  of  teaching  In  local 
schools  are  outlii.^J  in  the  following  sections.    Consistent  with  the  scope 
of  the  NCES  plan  to  redesign  Its  data  collection  activities,  the  data  needs 
identified  focus  primarily,  but  not  exclusively,  on  elementary  and  secondary 
education.    Data  have  been  Identified  by  posing  a  series  of  questions. 

These  questions  have  previously  been  raised  by  policy -makers  and  serve  as 
guidelines  for  Identifying  specific  data  which  need  to  be  obtained  through 
Q  data  collection  activities. 
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A  SAMPLE  OF 
QUESTIONS  TO  BE  USED  TO  IDENTIFY 
DATA  NEEDED  TO  SUPPORT  DELIBERATIONS  ON  POLICY  ISSUES 


I.  Teacher  Supply  and  Demand.    Teacher  demand  is  usually  defined  in  terms 
or  needed  staff  in  specific  subject  areas  within  individual  states. 
Colleges  and  universities,  however,  prepare  teachers  not  only  for  the 
states  where  they  are  located,  but  for  the  rest  of  the  nation  as  well. 

A.  What  is  the  supply  and  demand  balance  for  teachers  by  state,  by 
region,  and  by  specific  subject  area? 

B.  In  what  states  or  regions  is  demand  expecte(*  to  increase?  Decrease? 

C.  How  difficult  is  it  for  teachers  prepared  in  one  state  to  move  to 
another  state  where  need  might  be  greater? 

1.  What  certification  requirements  are  common  to  most  states? 

2.  What  core  of  certification  standards  and  qualifications  would 
enable  persons  preparing  to  teach  to  meet  most  state 

requi  rements? 

3.  How  common  are  reciprocal  agreements  between  states  which 
would  allow  persons  prepared  in  one  state  to  teach  in  another? 

D.  Can  non*teacher  experts  (persons  not  prepared  as  teachers  but 

/  recognized  as  experts  in  subject  matter  areas)  be  used  as  classroom 

teachers?  What  are  the  restrictions  or  limitations? 

II.  Recruitment  of  Prospective  Candidates  into  the  Teaching  Profession, 
Much  has  been  said  about  the  Increased  opportunities  for  women  in  the 
field  of  business  and  other  professions,  thus  removing  them  as 
potential  teacher  candidates.    There  is  also  concern  that  the  teaching 
profession  does  not  attract  the  best  and  brightest  students. 

A.  Why  do  persons  choose  or  not  choose  to  become  teachers? 

B.  What  local  working  conditions,  salaries,  or  social  conditions  would 
make  teaching  more  attractive  to  prospective  candidates? 

C.  What  problems  are  associated  with  recruiting  staff  for 
extracurricular  activities? 

III.  Recruitment  and  Selection  of  Teachers  by  Local  Districts.  Local 
districts  may  use  a  number  of  techniques  to  recruit  and/or  select 
teachers.   While  some  criteria  are  well  established,  ^uch  as  a 
satisfactory  academic  record,  tittle  is  known  about  the  variety  of 
criteria  or  degree  of  difference  in  the  use  of  specific  criteria.  In 
addition,  little  is  known  of  the  factors  which  limit  or  constrain 
recruitment  and  selection  practices. 

A.    What  procedures  are  used  by  districts  to  recruit  teachers?  What 
(,  techniques  have  been  particularly  useful  in  identifying  and 

recruiting  quality  candidates? 
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B.  What  do  local  districts  do  when  qualified  candidates  cannot  be 
recruited? 

C.  What  practices  are  employed  to  recruit  minority  candidates,  in 
addition  to  routine  recruitment  practices? 

D.  What  factors  most  constrain  recruitment  of  qualified  personnel  in 
local  districts? 

E.  Are  district  selection  procedures  clear  and  well  defined? 

1.  '   Do  districts  have  fully  developed  job  descriptions? 

2.  What  qualifications  are  required  of  all  candidates? 

3.  Do  district  qualifications  for  positions  exceed  minimum  state 
requirements? 

4.  Does  the  district  (or  state)  require  candidates  to  take 
qualifying  tests?   What  tests? 

5..    Who  are  the  personnel  who  actively  participate  in  the 
selection  of  educational  personnel? 

6.  What  are  the  most  important  criteria  used  in  the  selection  of 
teacher  candidates? 

7.  What  does  a  district  looi  for  during  an  interview  with  a 
candi  date? 

8.  Does  the  district  assess  a  candidate's  writing  skills  or 
abilities? 

9.  Do  districts  routinely  select  applicants  who  are  certified  to 
teach  in  more  than  one  area? 

IV.   Evaluation  and  Performance  of  Teachers.    Evaluation  practicGs 

Implemented  In  local  districts  may  have  an  important  effect  on  the 
quality  of  education.   More  needs  to  be  known  about  how  staff 
evaluations  are  conducted  and  what  practices,  if  any,  are  employed  in 
staff  development.   There  is  also  concern  that  budget  restrictions  and 
declining  enrollments  have  caused  school  administrators  to  assign 
tenured  staff  to  teach  in  fields  for  which  the"  lack  sufficient 
preparation. 

A.   Do  districts  employ  formal  evaluation  procedures  when  assessing  the 


performance  of  teachers? 


1. 


Are  standardized  evaluation  instruments  used? 


2. 


What  specific  criteria  are  used  to  evaluate  staff? 


3. 


How  often  are  staff  evaluated? 
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B.  Who,  in  local  districts,  evaluate  teachers?   What  spacial  training 
is  required  of  these  personnel? 

C.  If  an  evaluation  indicates  that  a  staff  member's  performance  is 
unsatisfactory,  what  subsequent  action  is  taken? 

D.  What  programs  for  staff  development  currently  exist  in  local 
school s? 

E.  What  restrictions  or  constraints  hinder  staff  development  or  the 
improvement  of  performance? 

F.  What  relationship  exists  between  performance  on  standardized 
teaching  tests  and  performance  in  the  classroom? 

G.  What  evidence  is  there  to  suggest  that  persons,  either  because  of 
insufficient  formal  training  or  because  of  a  long  absence  from  a 
given  teaching  field,  are  being  asked  to  teach  classes  for  which 
they  are  inappropriately  prepared? 

Retaining  Teachers.  -  Major  concerns  of  those  interested  in  improving 
the  quality  or  education  are  retaining  the  best  and  brightest 
practicing  teachers  and  removing  the  incompetent  teacher.  Conventional 
wisdoii.  suggests  that  mar\y  of  the  best  teachers  leave  the  profession  for 
positions  in  private  industry.    Yet,  little  is  known  about  those  who 
leave. 

A.  What  is  the  attrition  rate  of  teachers?   Is  teacher  turnover 
greater  or  less  than  turnover  of  personnel  in  other  professions? 

t 

B.  Are  those  who  leave  the  teaching  profession  the  most  qualified 
teachers?  The  better  performing  teachers? 

C.  Why  do  practicing  teachers  leave  the  profession?   If  they  leave,  do 
they  ever  return? 

D.  What  working  conditions  or  approaches  {e.g.  merit  pay^ 
differentiated  staffing,  etc.)  would  act  as  incentives  for  keeping 
the  best  teachers  in  the  classrooin? 

1.  What  are  the  factors  that  provide  the  most  job  satisfaction 
for  teaci.ci*s? 

2.  What  are  the  factors  that  create  the  most  dissatisfaction  for 
teachers? 

E.  What  are  the  constraints  associated  with  retaining  the  most 
competent  teachers? 

F.  What  are  the  constraints  associated  with  removing  the  incompetent 
teacher? 
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The  Council  o£  Chief  State  School  Officers  is  pleased  to  have  the 
opportunity  Co  comment  on  the  National  Center  for  Education  Statistics  ten 
year  plan  for  elementary  and  secondary  data  collection.    The  Council  is  a 
non-profit  organization  comprised  of  the  state  superintendents  and 
comaiis  si  oners  of  aducation  in  the  fifty  states,  six  extra-state 
jurisdictions  and  the  District  of  Columbia.    They  are  the  executives 
responsible  for  administering  the  nation's  public  education  enterprise 
consisting  of  approximately  8S|000  schools  with  approximately  40,000,000 
students  and  an  annual  expenditure  exceeding  ill9, 000, 000,000.00.  When 
combined  with  postsecondary  and  cpntinuing  education,  this  enterprise 
requires  37. &Z  of  state  government  expenditures,  42. of  Ic  U  government 
expenditures,  and  combined  with  federal  contributions  (4.1Z  of  federal 
expenditures)  total  expenditures  for  education  rank  second  only  to  ' 
National  Defense  and  International  Relations  in  terms  of  expenditures  from 
all  levels  of  government. 

It  is  natural,  then»  that  the  stewardship  of  this  enterprise  demands 
complete  and  accurate  information  for  accountability  to  the  public  and 
legislative  bodies »  for  the  support  of  effective  decision-making »  and  for 
the  assessment  of  educational  progress.    As  a  result,  the  Chief  State 
School  Officers  as  collectors »  processors »  responders^  and  users  of 
education  statistics  are  in  a  unique  position  to  provide  insight  into  the 
implications  of  plans»  changes  and  needs  for  data  and  information  about 
education. 
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The  Council  believes  that  the  National  Center  for  Education  Statistics 
has  a  vital  role  in  respcading  to  educational  needs  in  the  following 
general  areas: 

1*      Contextual  Paraioeters  or  descriptors  that  describe  the 
educational  enterprise 

2*      Indicators  o£  the  health  or  status  o£  education  and  its 
relationship  to  oth«ir  countries 

3*      Special  longitudinal  and  other  statistical  surveys  and  systems 
that  are  practical  only  at  the  national  or  federal  level 

4.      Assistance  to  state  and  local  agencies  in  the  design  and 
operation  of  activities  at  the  state  and  local  level* 

An  effective  combination  of  these  four  areas  will  result  in  increased 

opportunity  for  new  information  to  be  generated  by  the  Center,  researchers 

using  Center  data,  and  by  policymakers  analyzing  effect  and  impact  of 

change* 

It  is  important  to  point  out  at  the  onset  that  che  degree  to  which 
these  four  responsibilities  can  be  appropriately  met  is  highly  dependent 
upon  the  level  of  funding  for  the  varioua  activities*    The  Council  at  is 
November  1984  meeting  stated  that  the  U*S*  Department  of  Education  should 
"Request  increased  appropriations  for  assessment  and  evaluation  efforts  by 
five  to  six  times  the  current  level  (8+  million  per  year)  to  make  the 
capability  comparable  with  national  reporting  in  health,  agriculture  and 
o::her  federal  statistical  functions*    "A  failure  to  accept  the  cost  of 
producing!  reporting,  and  analyzing  statistical  information,  and  the 
subsequent  provision  of  funds  to  support  this  cost,  will  limit  any  real 
advance  to  piece-meal  efforts  with  neglible  improvements*'* 


1.    Contextual  Parameters  or  Descriptions 


Although  a  great  deal  of  attention  has  recently  been  focused  on  the 
combination  of  data  elements  to  assist  in  policy  analysis,  there  will 
always  be  a  need  for  basic  education  data*    How  many  districts,  schools, 
students »  teachers 9  administrators,  etc*  are  there?    How  much  money  is 
being  spent?    Data  that  define  the  size  and  the  scope  of  the  enterprise 
are  essential  and  will  continue  to  be  needed  by  users* 

The  Council  and  its  Coomitcee  on  Evaluation  and  Information  Systems 
(CEIS)  has  had  a  long  and  consistent  history  of  supporting  the  concept  and 
implementation  of  a  Common  Core  of  Data  that  describes  the  system 
statistically*    The  philosophy  of  a  federal^state  cooperative  data  system 
to  respond  to  federal  data  needs  from  state  and  local  administrative 
records  is  one  that  has  been  pursued  since  1961*    The  necessity  of 
maintaining  a  cooperative  approach  is  critical  to  the  continued  and 
enhanced  ability  of  the  federal  government  to  collect  either  voluntary  or 
contracted  data  on  a  systematic  basis*    Consequently,  we  applaud  the 
National  Center  for  its  approach  in  soliciting  input  from  a  broad  variety 
of  audiences  on  a  formal  basis*    We  encourage  the  involvement  of  CCSSO  and 
its  Committee  on  Evaluation  and  Informatlion  Systems  at  each  stage  of  this 
process* 

CCSSO  encourages  the  Center  to  cooperatively  define  those  data 
elements  that  can  be  efficiently  collected  with  universe  information  that 
^  will  improve  sample  selection  procedures  without  unduly  increasing 
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reporting  burdens.    This  would  include  data  on  the  school  district 
universe  and  the  school  universe* 

Scandardization  and  coordination  of  data  definitions  at  the  federal 
level  is  a  role  that  may  be  appropriate  for  NCES.    This  coordination,  and 
the  attendant  acceptance  of  the  development  and  distribution  of 
glcssaries,  is  necessary  to  promote  the  improved  compatrability  of 
information.    Additionally,  the  acceptance  of  this  role  would  increase  the 
confidence  of  data  users  that  information  in  given  formats  would  be 
available  over  time  and  not  subject  to  changing  program  emphasis  or 
approaches. 

The  Council  will  gladly  assist,  through  i:ts  CEIS  as  well  as  in  other 
appropriate  ways,  in  the  identification  of  useful,  necessary,  or  improved 
CCD  data  elements  as  well  as  suggesting  elimination  of  those  that  have 
proven  to  be  of  little  value. 

The  Council  looks  to  NCES  as  a  provider  of  information  relative  to 
non-pvblic  schools  as  a  basis  for  analyzing  total  educational 
information.    Additionally,  the  establishment  of  comparable  statistics 
about  education  in  other  countries  would  be  most  useful  as  states  analyze 
their  own  data  sets. 

Finally,  the  provision  of  current  information  is  a  goal  chat  NCES 
should  constantly  be  striving  to  improve.    The  CCSSO  recognizes  the 
problems  in  collecting  data  and  its  impact  on  the  delay  in  publishing 
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information  but  is  convinced  that  a  rapid  turnaround  of  information  is 
essential  for  improved  services.    The  recently  established  bulletin  board 
is  a  positive  step  in  this  direction  but  electronic  display  of  old 
information  is  holding  out  only  half  a  promise  for  improvement. 

2.  Indicators. 

The  Council  fully  endorses  the  Condition  of  Education  and  the 
Indicators  of  Education  Status  and  Trends  and  encourages  continued 
cooperative  development  in  conversion  of  statistical  da^a  into  information 
that  is  useful  in  describing  the  effects  of  the  schooling  process. 
Appropriate  statistics  that  are  not  part  of  the  Common  Core  of  Data  should 
be  gathered  by  NCES  from  other  sources  or  through  special  surveys  or 
procedures  using  sampling  whenever  possible.    Analysis  of  the  design  of 
these  special  surveys  or  activities  should  consider  the  possibility  of 
state  use  and  in  addition  to  the  national  requirements.    The  aggregation 
of  data  about  education  collected  by  other  federal  agencies  (such  as  those 
reported  in  the  Condition  of  Education  and  the  Indicators)  into  a  coomoa, 
accessible  data  base  suv^h  es  the  nevly  created  bulletin  board,  coild  be  of 
considerable  value  to  the  states  as  data  users. 

3,  Special  longitudinal  and  other  statistical  surveys  and  systems  that 
are  practical  only  at  the  national  and  federal  levels 

The  Council  ii  fully  supportive  of  the  NCES  High  School  and  Beyond 
Survey  and  the  planned  National  Education  Longitudinal  Survey  of  1988. 


The  activities  have  provca  to  be  extremely  helpful  in  generating  a  variety 
of  new  information  on  courses,  attitudes,  relationship?,  and  results.  Aa 
stated  earlit.r  ve  would  encourage  consideration  of  developing  these 
activities  in  a  way  that  results  in  state  representative  as  well  as 
nationally  representative  data.    It  is  recognized  that  this  introduces 
additional  cost  for  these  activities  but  CCSSO  looks  to  NCES  to  serve  as 
the  state's  advocate  in  soliciting  necessary  funding  to  accomplish  this. 

4.    Assistance  to  State  and  Local  Agencies 

A  review  of  effective  statistical  and  information  systems  clearly 
indicates  that  successful  programs  are  dependent  upon  the  capability  of 
respondents  to  provide  accurate  information*    Accurate  and  reliable 
information  at  the  federal  level  is  possible  in  direct  proportion  and 
relationship  to  the  development  and  improvement  of  support  systems  at  the 
state  and  local  level.    This  concept  is  embodied  in  the  federal-*state 
cooperative  data  collection  systems  which  have  involved  direct  federal 
financial  assistance  to  states  for  the  development  of  their  systems.  Such 
cooperative  systems  have  become  operational  in  the  Department  of  Labor, 
Bureau  of  the  Census,  Law  Enforcement  Assistance  Administration,  and  the 
Department  of  Agriculture.    Other  specific  examples  of  such  systems  incude 
the  Coopeative  Health  Statistics  Systems  and  the  Medicaid  Management 
Information  System. 

In  education,  however,  assistance  activities  have  had  an  uneven 
history  and  have  been  a  woefully  underfunded.    As  resources  from  all 


ERLC 


678 


levels  become  more  scarce  the  competition  for  these  limited  funds  by  all 
aspects  of  general  program  administration  will  make  it  more  difficult  to 
develop  improved  data  systems.    Information  and  statistics  are  not  a 
natural  by^iroduct  produced  at  no  cost;  but  rather  a  commodity  which  must 
be  produced  by  someone  and  paid  for  by  some  agency.    The  CCSSO  encourages 
NCES  to  seek  sufficient  resources  to  permit  all  levels  of  government  to 
have  resources  to  generate  the  data  that  the  Federal  Government  needs  to 
report  timely,  accurate* and  comprehensive  statistics.    If  the  resources 
are  not  made  available,  inadequate  reporting  results  or  funda  and  efforts 
must  be  diverted  from  more  important  activities  related  to  program 
administration  or  instruction.    Neither  of  those  alternatives  is 
acceptable. 

As  indicated  earlier,  the  Council  would  be  most  happy  to  assist  in  the 
detailed  development  of  specific  data  items  that  make  up  the  component 
parts  of  the  ten-year  plan  in  a  more  thorough  manner.    The  need  to  analyze 
use  of  data  collected,  at  well  as  the  cost  of  dat^  to  provide  are 
questions  that  need  a  great  deal  of  attention  «nd  assistance  from  state 
and  local  providers  and  are  as  important  as  the  definition  of  data 
elements.    A  federal  data  system  that  is  not  useful  or  practical  to  the 
state  and  local  education  agencies  providing  information  will  not 
succeed.    Effective  dialogue,  coordination  and  assistance  will  allow  an 
enhanced  opportunity  for  all  partners  to  access  and  use  valid,  reliable 
and  timely  statistics. 
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July  19,  1985 


Mr.  Leslie  Silveraan 
Deputy  AssLSCanC  Administrator 
Division  of  Statistical  Services 
National  Center  for  Education 

Statistics 
U.S.  Department  of  Education 
1200  Nineteenth  Street,  N.W. 
Washington,  D.C.  20208-1401 


Dear  Leslie: 


At  our  July  16,  1985  meeting  of  the  CCSSO  Ad  Hoc  Committee  on  the 
NCES  Elementary-Secondary  Data  Program  Redesign  Project,  it 
became  apparent  that  the  direction  and  limits  of  the  project 
would  be  impacted  by  the  perceived  mission  and  functional 
boundaries  assumed  for  the  National  Center  for  Education 
Statistics.    We  strongly  urge  that  the  function  be  a  true 
statistical  center  that  assumes  the  major  responsibility  foe 
coordination  o£  Uhe  collection,  assembly,  analysis  and 
dissemination  for  that  sector  of  society  under  its  purviev, 
namely  education. 

The  Secretary  of  Education  would  be  required  to  make  a  clear  and 
comnitted  designation  that  the  Center  would  have  responsibility 
for  coordination  of  statistical  data  collection  and  analysis 
activities  across  the  Department  of  Education  regardless  of 
organisational  lines  und/ov  bureaucracies.    This  assignment  would 
also  require  that  the  Center  be  charged  with  promoting  the 
integration  of  the  numerous  data  collection  activities  conducted 
by  other  federal  agencies  (Department  of  Agriculture,  Bureau  of 
the  Census,  Departmect  of  Labor,  ec  al.)  and  related  private 
agencies  (National  Education  Association,  American  Council  on 
Education,  and  the  testing  industry)  to  minimize  burden  on 
respondents  and  to  develop  increas«>d  standardization  of 
terminology. 


Edncafcia 

aioand 


ERIC 


Lh     JIWIBWIA  COUNCIL  OF  CHIEF  STATE  SCHOOL  OFFICERS 

I  ^    PtI^'M""  ^  379  Hall  of  lha  Slatai.  400  North  Capitol  Street.  N.W..  Washington.  D.C.  20001  •  202/393  0161 


680 


692 


c 

Mr*  Leslie  Silverman 
July  19,  1985 
Page  2 

This  coordination  role  would  include:  1)  first  and  foremost,  the 
coordination  of  the  various  activities  currently  under 
development  in  NCES  (e.g.,  CED,  VEDS,  NELS-88) ;  2)  expansion  of 
the  system  to  include  those  other  data  collection  activities  by 
the  Department  of  Education  (e.g..  Special  Education,  Chapter  I 
of  ECIA,  Chapter  II  of  the  Math  and  Science  Act);  and  finally  3) 
establishment  of  out^reach  activities  to  other  agencies  to  ensure 
appropriate  federal  and  national  coordination.    Included  in  this 
function  would  be  defining  a  coooion  set  of  data  elements  across 
the  spectrum,  coordinating  collection  of  all  statistical  data, 
developing  efficient  collection  and  dissemination  systems  (in 
conjunction  with  users  and  providers),  seeking  out  current  needs 
for  educational  information,  and  providing  assistance,  both 
technical  and  financial,  to  the  respondees  and  users  of 
'   educational  data. 

Any  effort  at  a  ten-year  plan,  without  a  clear  understanding  of 
the  agency's  mission  and  philosophy,  offers  little  promise  of 
success.    Additionally,  in  our  view,  the  failure  to  expand  the 
mission  and  functional  boundaries  of  the  National  Center  to  a 
true  center  for  education  statistics  limits  the  potential  growth 
to  little  more  than  that  capacity  which  exists  today. 


Staff,  Council  of  Chief  State 
School  Officers 

GR:fkc 

cc:    Emerson  Elliott 
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September  20,  1985 


Emerson  Elliott 
Administrator 

National  Center  for  Education  Statistics 
1200  19th  Street,  N.W.  #606D 
Washington,  D.C.    20208  1 


Dear  Bnerson: 

The  Council  of  Chief  State  School  Officeis's  Ad  Hoc  panel  on  the 
NCES  Elementary/Secondary  Education  Redesign  Project  appreciates  the 
opportunity  you  have  afforded  the  task  force  to  provide  input  into 
this  iiqwrtant  review  and  planning  process.    The  recent  heightened 
interest  in  educational  statistics  and  information  for  program 
reform,  system  accountability,  policymaking  and  applied  research 
suggests  the  need  for  an  accurate,  timely  and  comprehensive  data  base 
of  statistics  aggregated  in  a  manner  that  does  not  place  an  undue 
burden  on  current  local  and  state  information  systems.   We  are 
encouraged  that  NCES  has  initiated  such  a  thorough  review  and  look 
forward  to  assisting  the  Center  formulate  alternative  approaches  to 
address  this  need. 

The  Ad  Hoc  panel  met  on  September  10th  to  review  a  draft  of  the 
••Synthesis  of  Invited  Papers"  and  to  consider  future  steps  in  the 
redesign  project.    This  meeting  resulted  in  the  following  general 
recommendations . 

1.  The  Center  should  develop  a  clear  mission  statement,  along  with 
an  organizing  theory  for  the  integration  of  administrative  record 
systems,  sanple  surveys  and  longitudinal  activities.  The 
statement  should  address  the  Center's  role  in  approving, 
coordinating,  aggregating,  maintaining  and  reporting  information 
collected  about  education  from  other  units  of  the  Department  of 
Education  and  other  Federal  agencies. 

2.  The  regional  public  hearings,  which  the  Ad  Hoc  Committee 
supports  as  an  effective  means  for  fully  involving  many 
participants  in  the  process  of  providing  and  using  educational 
data,  should  be  scheduled  for  the  first  quarter  of  1986  rather 
than  the  last  quarter  of  1985.    The  delay  would  be  justified  by 
the  time  required  to  fully  involve  all  parties  impacted  by  these 
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proceedings  and  supply  them  with  appropriate  information  in 
advance,  including  drafts  of  the  plan. 

3.  NCES  should  consider  state  representative  samples  on  all 
NCES-sponsored  surveys  and  longitudinal  study  activities. 
Although  this  approach  could  result  in  increased  costs  to  the 
federal  government,  recognition  of  the  potential  importance  of 
resulting  information  would  justify  the  expenditure. 

4.  Any  atteirpt  to  construct  model  state  and  local  information 
systems  should  include  an  examination  and  analysis  of  the  record 
of  past  efforts  such  as  the  Midwestern  State  Educational 
Information  Project,  the  USOE  Handbook  Series,  the  Belmont 
Project,  the  Committee  on  Educational  Data  Systems  Manual  and 
others . 

5.  NCES  shojild  exercise  caution  in  balancing  the  legitimate 
desire  of  researchers  and  policymakers  for  detailed  information 
with  the  cost  and  capability  of  institutions  providing 
information.    In  its  redesign  project,  NCES  should  consider 
factors  such  as  the  separation  between  research  and  statistics, 
state  and  local  policymaking  as  contrasted  with  the  federal  role, 
and  finally,  the  cost  of  information  systems  and  their  potential 
intrusion  on  the  instructional  process. 

6.  NCES  should  approach  collection  of  data  directly  from  local 
agencies  with  caution.   While  this  is  appropriate  at  times  for 
sample  surveys,  it  intensifies  and  coin)ounds  extant  problems  of 
data  definitions,  comparability,  reliability  and  potentially 
detracts  from  the  possibility  of  developing  administrative  record 
systems  that  will  meet  a  variety  of  needs.  Additionally, 
appropriate  federal/state/local  protocol  should  be  honored  in 
intergovernmental  communications.   CCSSO  has  long  recognized  the 
need  to  collectivly  wo^k  with  the  federal  government  to  ensure 
that  data  collected  is  valid,  useful  and  collected  with  a  minimum 
of  intrusion.   The  Committee  on  Evaluation  and  Information 
Systems  (CEIS)  continues  to  be  an  effective  vehicle  for 
accomplishing  this  task. 

Again,  the  Ad  Hoc  Committee  appreciates  the  opportunity  of 
providing  input  into  the  process  and  encourages  the  writing  team  for 
the  plan,  NCES  staff,  and  yourself  to  call  upon  us  for  assistance. 


ASSESSING  THE  EDUCATION  STATISTICS  INFORMATION  MEEDS 
OF  NON-SEA  PUBLIC  POLICY  DECISION  MAKERS 


xnvited  paper  prepared  by  The  Council  of  State  Governments 
Office  of  Information  Services  for  the 
National  Center  for  Education  Statistics. 


by 

Mr.  E.  Nonnan  Sims,  Director 
Office  of  Infomiation  Services 

Or.  Deborah  A.  Gona,  Coordinator 
Survey  Research  Services 


June  1985 
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Assessing  the  Education  Statistics  Information  Needs  of 
Non-State  Education  Agency  Public  Policy  Decision  flakers 


The  last  half  century  in  the  United  States  brought  a  significant 
change  to  education  policymaking  as  our  system  of  public  education 
moved  from  one  with  a  "political"  character  to  one  with  a 
"professional"  character.    This  has  bee;i  noted  by  Cremin  who  explains: 


The  schools  of  a  century  ago  --  party-dominated, 
patronage-controlled,  professionalism  ignored  --  were 
transformed  over  the  next  half  century  by  a  combination 
of  businessmen,  professionals,  and  a  new  breed  of 
university-trained  administrators.    Their  enemy  was  the 
political  machine  and  the  political  boss.l  ' 

One  outgrowth  of  this  movement  was  the  development  of  a  distaste 
by  the  professional  education  community  for  all  things  political. 
As  a  result,  the  school  profession  began  to  maintain  the  "purity  of 
its  motives  and  values  and  the  sinfulness  of  party  activity  and 
partisanship. "2    in  the  late  1950s,  however,  educators  began  to  see 
themselves  as  the  focus  of  a  discontent  generated  by  their  clientele. 
In  the  1970s,  this  discontent  had  grown  to  the  point  that  serious 
questions  were  being  asked  about  the  quality  and  quantity  of 
professional  educational  services  which  seemed  to  be  growing  in 
expense. "5   Most  recently  this  concern  has  been  expressed  by  the  report 
of  the  National  Commission  on  Educational  Excellence  which  recommends 
a  wide  range  of  educational  reforms  to  halt  the  "rising  tide  of 
mediocrity." 

In  part  because  of  this  discontent,  there  Is  now  a  movement  at 
the  policymaking  level  away  from  technical,  professional  educators 
toward  domination  by  political  actors.    Social  and  economic 
conditions,  which  have  in  the  past  supported  the  image  of 
professionalism  and  independence,  have  changed..  Educational 
policymaking  has  become  more  political  than  technical 

Accompanying  this  movement  have  been  two  other  trends  which  are 
of  equal  or  superior  Importance:  a  shift  of  the  primary  political 
arena  for  education  from  the  local  level  (the  local  education  agency, 
or  LEA)  to  the  state  level  (usually  the  State  Education  Agency,  or 
SEA)3;  and  a  resurgence  of  the  non-SEA  state  decision  makers,  such 
as  the  state  legislature  and  the  governor,  as  major  factors  i-  the 
development  of  state  educational  policies. ^ 

Various  forces  are  combining  to  cause  these  shifts.  They 
include:    judicial  actions  --  particularly  in  the  area  of  school 
finance  --  which  have  forced  many  state  governments  to  reconsider 
fundamental  educational  policies  formulated  within  SEAs  and  LEAs ; 
federal  involvement  in  educational  finance  and  policymaking  which  has 
also  spurred  the  develop:nent  and  expansion  of  the  SEAs ;  and  the 
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irnpact  of  movements  to  reduce  taxes,  particularly  by  those  who  felt 
that  they  carried  an  unnecessary  local  property  tax  burden. ^ 

As  educational  policymaking  has  moved  from  the  local,  technical- 
issue  level  to  the  state,  public  policy  decision  maker,  an  unfortunate 
schism  developed  at  both  the  level  of  the  user  (between  the 
professional  educator  and  the  political  decision  maker)  and  the 
provider  (between  information  and  policy  centers  serving  legislators 
and  executive  branch  agencies  and  those  serving  educators). 

Unfortunately,  for  those  involved  in  improving  state  educational 
decision  making  by  providing  adequate  information,  this  schism  has  more 
than  historical  importance  and  is  nowhere  more  apparent  than  in  the 
area  of  research  into  the  information  needs  and  uses  of  these  state 
decision  makers  and  the  provision  of  Information  to  them.  Obviously 
the  non-SEA  political  actors  make  Important  education  decisions.  But 
we  know  very  little  about  the  information  they  use,  want  or  need  in  the 
process  • 

The  federal  government,  through  the  U.S.  Department  of  Education 
and  its  National  Institute  of  Education  and  National  Center  for 
Education  Statistics,  has  made  great  strides  in  helping  to  improve 
decision  making  and  use  of  information  in  SEAs  and  LEAs ,  not  only 
through  research  into  better  education  programs  but  al^o  through  the 
the  dissemination  of  the  results  of  these  research  efforts.  Indeed, 
numerous  studies  have  supplied  information  about  educational  decision 
making  within  the  SEA. 8   Moreover,  work  by  a  variety  of  educational 
groups  has  enl  ighted  us  about  several  aspects  of  information  delivery 
to  decision  makers  within  the  SEAs  and  LEAs. 

The  state  Capacity  Building  (CBG)  and  Research  and  Development 
Utilization  (RDU)  projects,  as  well  as  the  Research  and  Development 
Exchange  (RDx)  and  National  Diffusion  network  (NDN)  programs,  have 
provided  crucial  data  about  facets  of  the  information  process. 

Throughout  the  working  life  of  each  of  these  projects,  new 
knowledge  emerged  about  the  process  of  decision  making,  resource 
delivery  and  client  assessment. 9   But  as  Mattas  and  Rawnsley  have 
suggested,  in  the  design  and  operation  of  information  services  it  is 
important  to  know  more  than  which  members  of  the  educational  community 
(the  direct  clientele  of  the  educational  research  community)  make  use 
of  services  offered  and  what  information  they,  request.  Research 
interest  should  also  be  directed  toward  alj^  knowledgeable,  and 
unknowl edgeabl  e,  information  users  and  non-users  who  have  influence  on 
the  policymaking  process.l'^ 

Again  what  is  quite  clear  as  we  consider  the  great  national 
debates  over  such  issues  as  the  role  of  the  private  sector  in 
education  and  the  operation  of  our  intergovernmental  system,  is  th^.t 
the  major  policy  decisions  which  affect  education  will  not  be  made 
entirely  in  the  SEAs  and  LEAs.    They  will  be  made  by  legislators, 
legislative  staffers,  governors,  budget  directors,  state  planning 
officers  and  others.    These  other  actors  may  be  familiar  with  the 
results  of  educational  research  and  its  application  to  policy,  but  it 
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is  more  likely,  as  we  shall  see  later,  that  their  knowledge  is  scanty 
(coming  to  them  secondhand)  and  based  upon  information  which  is  pogrly 
provided  or  limited  in  applicability. 

It  is  also  likely  that  educational  decisions  at  the  state  level 
will  be  based  upon  information  provided  by  sources  other  than  those 
normally  considered  as  information  providers  by  the  education 
community*    The  Council  of  State  Governments  1984-85  edition  of  the 
Book  of  the  States,  for  example,  lists  90  organizations  which  may  be 
caTTed  upon  by  state  policymakers  tc  deliver  this  information. 

The  day  when,  as  political  scientist  Alan  Rosenthal  reports,  a 
typical  state  legislator,  asked  about  the  legislative  role  in 
elementary  and  secondary  education,  replied  quizzically,  "Education  is 
a  local  thing;    we  don't  have  anything  to  do  with  that;   there's  a 
formula",  is  over.^l    The  schism  between  the  technical  and  the 
political,  which  has  led  to  research  into  the  information  needs  and 
uses  of  professional  educators  while  ignoring  the  political  community, 
and  the  service  agencies  that  support  them,  needs  to  be  bridged. 

It  is  the  view  of  The  Council  of  State  Governments  that  the  U.S. 
Department  of  Education       acting  uniiormly  or  through  an  internal 
entity  such  as  the  National  Center  for  Education  Statistics  should 
take  the  steps  necessary  to  construct  this  bridge  by  planning  and 
taking  action  tc  achieve  three  program  goals: 

—  Increase  our  knowledge  and  understanding  of  how  state, 
educational  pol  icy  decision  makers  use  statistical  information 
to  make  decisions  and  about  their  information  needs; 

—  Assess  the  capacity  of  statistical  information  providers  to 
assist  state  education  policymakers  to  make  better  use  of 
available  statistical  information  resources,  and  offer 
statistical  information  providers  insight  into  mechanisms 
for  improving  their  services;  and 

Based  upon  this  Information  user  and  provider  analysis, 
develop  a  plan  for  improving  the  communication  of  useful 
statistical  information  to  the  non-SEA  state  educational 
policymakers. 

When  these  goals  are  met,  it  is  The  Council 's  view  that  the  U.S. 
Department  of  Education  will  have  significantly  added  to  our  knowledge 
of  how  the  process  of  governing  education  and  making  policy  decisions 
might  be  made  more  effective.    It  will  have  also  increased  our 
understanding  of  the  natu'"'^  of  program  administration  by  keying  on 
executive  and  legislative  branch  decision  makers  as  information  users 
and  the  national  service  agencies  (such  as  The  Council  of  State 
Governments)  which  support  them. 

It  is  the  experience  of  The  Council  of  State  Governments  that  the 
provision  of  better  information  to  state  officials  does  result  in 
better  decision  making.    But  information  is  a  powerful  tool  only  when 
it  is  provided  to  the  right  people,  in  the  right  way,  at  the  right 
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time. 


The  effort  we  suggest  would  assist  the  education  community  in 
forging  more  powerful  information  tools  by  providing  the  knowledge  to 
give  these  tools  better  form  and  function. 


The  Information  Needs  of  State  Policymakers 

In  the  early  sumrer  of  1978,  a  symposium  was  held  in  Arlington, 
Virginia,  to  review  the  experiences  of  various  state  and  federal 
managers  with  the  institutionalization  of  federal  programs  at  the 
local  level. 

This  symposium,  sponsored  by  the  MITRE  Corporation,  the  National 
Institute  of  Education  and  the  National  Institute  of  Law  Enforcement 
and  Criminal  Justice,  focused  on  demonstration  projects,  but  the 
comnients  made  by  the  participants  were  telling  from  a  number  of 
perspectives.    Mr.  David  L.  Foote,  Executive  Director  of  the 
Colorado  State  Office  of  Planning  and  Budgeting,  provided  support 
for  the  effort  we  suggest  when  he  told  the  federal  program  managers: 

If  I  had  a  single  recommendation  to  make  to  the  federal 
establishment  ...  it  would  be  to  take  planning  seriously.  Not 
planning  for  demonstration,  but  what  I  would  call  policy 
planning,  and  making  sure  that  we  benefit  from  utilizing 
information  that  we  continually  generate  and  ask  others  to 
generate. 12 

As  NCES  has  indicated  through  this  requst  for  papers,  the 
public  policy  challenges  facing  our  system  of  federalism  — 
particularly  in  the  area  of  education  and  its  administration  are 
formidable  and  can  only  be  dealt  with,  as  Mr.  Foote  indicates,  by 
providing  information  to  state  policymakers  in  the  most  effective 
ways  possible.    But  as  we  have  noted  above,  these  policymakers 
include  a  broad  spectrum  of  public  officials  inside  and  outside  of 
the  SEA. 

In  studying  how  legislative,  administrative  and  judicial  policies 
and  governmental  organizations  affect  education,  the  most  important 
questions  may  be:   What  statistical  information  is  used  by  state 
policymakers  to  make  decisions?;  What  information  do  they  thinl>  they 
lack  to  make  better  decisions?;  How  do  they  wish  the  material  to  be 
presented  to  make  it  most  useful?;  What  lessons  can  statistical 
information  producers  and  providers  learn  from  the  information  needs 
and  wants  of  these  state  policymakers? 

It  seems,  however,  that  because  of  the  political/technical 
education  schism,  educational  research  has  not  focused  on  the 
information  needs  of  decision  makers  in  the  political  environment. 
One  portion  of  the  effort  The  Council  would  propose  to  NCES  would  be 
to  attempt  to  study  the  information  barriers  to  good  education  policy 
decision  making  which  exist  in  that  environment. 
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A  project  recently  completed  by  the  ERIC  Clearinghouse  on 
Teacher  Education  attempted  to  overcome  one  of  the  barriers  to  sound 
policy  planning  by  identifying  state  polic>maker  infonnation  needs. 
But  this  study  focused  on  three  of  the  national  state  government 
service  agencies  rather  than  the  policymakers  themselves. 

Several  efforts  have  been  made  by  the  state  government  research 
community       including  efforts  by  The  Council  of  State  Governments 
to  assess  the  information  needed  and  used  by  state  public  policy 
decision  makers.    They  have  dealt,  for  the  most  part,  with  the 
elected  members  of  the  legislative  branch,  but  have  not  considered 
conditions  as  they  specifically  affect  education.    These  studies  have 
centered  on:    the  peculiarities  of  the  legislature  as  an  Information- 
using  institution;  the  kinds  of  general  infonnation  legislators  say 
they  need;  the  interpretation  of  their  needs  by  their  staff;  certain 
effects  of  the  decision-making  process  on  information  use;  and 
sone  constraints  of  the  political  environment  on  good  Information  use. 
The  findings  of  these  non-education  issue  specific  studies  provide 
the  research  background  for  the  first  goal  of  the  proposed  effort. 

In  general,  state  officials  (particularly  state  legislators)  must 
make  many  decisions  within  a  relatively  short  period  of  time.  This  is 
largely  due  to  the  fact  that  the  volume  of  state  business  with  which 
they  must  deal  is  rapidly  increasing  and  the  questions  put  before  them 
often  require  quite  specific  and  detailed  knowledge  of  the  issue  area. 
As  a  result,  the  kind  of  information  these  officials  need  in  order  to 
make  timely  decisions  is  often  not  readily  avail  able. ^3 

Moreover t  researchers  have  found  that  these  time  constraints  have 
forced  the  state  official  to  become  an  information  "schizophrenic." 
Generally  the  decision  maker  says  that  he  or  she  wants  information 
that  is  trustworthy,  objective,  reliable,  comprehensive,  applicable, 
and  timely. 1^    However,  while  they  might  be  quite  vocal  about  the 
quality  and  comprehensiveness  of  the  infonnation  desired,  they  rarely 
seek  elaborate  information  on  policy  issues.    Indeed,  In  the  state 
legislature  this  might  lead  to  an  infonnation  overload  causing, 
"Paralysis  (and)  making  things  incomprehensible  and  unmanageabl e."15 

As  a  result,  although  policymakers  talk  about  their  information 
needs,  and  on  some  topics  their  needs  may  be  intense,  they  rarely 
seek  elaborate  information.    When  they  get  it  unsolicited  they  do  not 
know  what  to  do  with  it.^^    Even  legislative  staff  report  a  difficult 
time  interpreting  legislators'  requests  b<?cause  of  this  duality  of 
infonnation  needs. 

If  the  literature's  portrayal  of  state  legislators  (and,  although 
most  of  the  research  tends  to  deal  only  with  the  legislative  branch, 
there  is  reason  to  believe  that  these  conditions  exist  within  the 
top-levels  of  the  executive  branch  as  well)  is  accurate,  why  should  we 
be  concerned  with  the  statistical  information  needs  of  these  actors? 
When  we  consider  the  "general"  use  of  infonnation,  it  does  seem  as 
though  this  schizophrenic  information-seeking  behavior  would  argue 
\  against  any  efforts  to  improve  the  provision  of  infonnation  relating  to 

education  issues. 
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But  while  this  composite  portrayal  is  essentially  accurate,  it 
is  -'Sleading  when  viewed  apart  from  other  aspects  of  the  state 
decision  making  process. 

Throughout  a  legislative  session,  for  example,  legislators  will 
receive  information  they  cannot  use.    This  is  because  the 
information  did  not  reach  them  at  the  right  time  in  the  legislative 
process;  it  did  not  help  with  problem  solving;  it  did  not  support 
the  decision  makers'  predispositions;  it  was  not  in  a  format  which 
enaLled  the  legislators  to  relate  it  to  constituent  needs;  or  it 
did  not  tell  the  legislators  how  colleagues  felt  about  the 
issue.18.19.20 

It  is  also  a  political  reality  that  not  every  legislator  or 
executive  branch  decision  maker  will  be  interested  in  every  issue. 
Yet  these  decision  makers  will  still  face  the  prospect  of  having  to 
make  decisions  oii  those  issues  either  by  endorsing  them  as  executive 
policy  or  voting  for  or  against  them  during  the  legislative  session. 

As  a  result,  these  officials  will  be  forced  to  rely  on  decision 
making  "shortcuts"  in  order  to  survive  the  flood  of  decisions  that  must 
be  made.    One  method  legislators  have  for  making  quick,  but  palatable 
decisions,  is  to  rely  on  the  orientations  or  predispositions  they  have 
brought  to,  or  developed  early  in,  their  legislative  careers.    It  is 
improbable  that  the  individual  legislator  will  have  preset  notions  on 
every  issue  to  be  addressed,  but  it  is  likely  that  one  or  more  of  the 
legislator's  colleagues  will  have  some  ideas  about,  or  expertise  in,  a 
particular  issue  area.    It  is  expected  then— and  supported  by  the 
research  1 iterature--that  when  an  individual  policymaker  cannot  arrive 
at  a  decision  on  the  basis  of  personal  judgment,  he  or  she  will  look 
elsewhere  for  assistance.    But  to  whom  does  he  or  she  look? 

Legislators  look  mainly  to  their  colleagues  and  rely  on  their 
judgments. 21    A  small  group  of  individuals  within  the  legislature  is 
likely  to  he  regarded  as  expert  in  a  particular  subject  or  issue  area, 
nther  members  can  usually  rely  on  their  ability  to  produce  policies 
which  reflect  the  values  of  the  group  as  a  whole. '^'i   Various  studies 
have  shown  that  policymakers  tend  to  look  within  their  own  group  for 
cues  for  decision  making  rather  than  to  outsiders  (such  as  SEA,  federal 
education,  or  educational  lab  and  center  staff)  .23, Lobbyists 
particularly  have  recognized  the  importance  of  seeking  out  those 
members  of  the  policymaking  group  who  are  seen  as  opinion  leaders.^ 
Soine  education  lobbyists  have  documented  their  strategies  for  informing 
these  key  1  egisl ators.28 

These  opinion  leaders  are  also  important  in  that  they  tend  to 
occupy  key  oositions  in  a  two-step  flow  of  communication  between 
interested  groups  and  individuals  on  the  outside  and  the  rest  of  their 
cor.:?gues  on  the  inside. 29    As  a  result,  the  ways  in  which  these 
individuals  with  substantive  knowledge  make  decisions,  and  the  criteria 
they  employ,  will  differ  from  that  of  their  less  knowledgeable,  less 
Interested,  fellows.^O  ^ 

But  it  is  unclear  just  how  these  non-SEA  "opinion  leaders"  make 
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their  decision:,  and  what  their  statistical  information  needs  are. 
More  specifically,  it  is  not  dear  how  the  non-SEA  legislative  and. 
executive  branch  education-  opinion  leaders  make  such  decisions  and 
e:nploy  statisticdl  information. 

On  the  basis  of  recent  studies^^,  we  have  some  ideas  as  to  why 
legislators  become  involved  in  education  policy  and  are  regarded  as 
leaders  in  the  area  (e.g..  legislator's  background  and/or  district 
characteristics).    On  the  basis  of  some  isolated  case  studies,  we  also 
have  some  understanding  of  the  factors  which  affect  education 
policymaking  in  various  states. ^2    But  these  findings  leave  many 
questions  unanswered  and  complicate  our  understanding  of  the  decision 
making  process  as  it  relates  to  education: 

--The  literature  suggests  that  education  policy  questions  are 
handled  differently  than  other  policy  questions  by  state 
legislatures,  simply  because  of  the  nature  of  the  political  and 
educational  environment.^^ 

—The  key  opinion  leaders  in  the  field  of  education  may  not  be 
make  up  solely  of  members  of  the  education  committees  and 
education  legislative  staff,  although  that  is  usually  where 
information  studies  related  to  education  policymaking  focus 
their  attention.    The  leadership  of  the  appropriations  and 
finance  committees,  for  instance,  also  have  power  over 
educational  policymaking.    A  participant  in  education  politics 
from  a  midwestern  state  notes,  "They  can  have  a  nice  time  in 
house  education  talking  about  textbook  selection,  competency 
based  education,  and  a  lot  of  other  things  like  that.    Not  much 
is  going  to  happen  on  those  things.    It's  the  people  who  control 
the  money  who  are  calling  the  shots  up  and  down  the  line.*''^^ 

--The  greatest  source  of  infonnation  used  by  the  state  education 
community,  the  information  produced  by  the  federal  government, 
is  not  widely  used  by  the  non-SEA  public  policymakers.  Research 
on  the  influence  of  this  information  upon  state  political  actors 
is  surprisingly  sparse.    This  is  partly  because  it  is  relatively 
new,  partly  because  the  information  is  seen  as  being  more  useful 
to  the  school  community,  and  partly  because  the  federal 
information  base  on  educational  operations  has  not  resulted  in 
any  theory-guided  research  literature. 35    Indeed,  one  study 
found  that  federal  information  providers  constitute  the  last 
group  State  non-SEA  problem  solvers  call  upon  for  sol utions.*^^ 
Wirt  has  noted  that  the  federal  thrust  for  providing  information 
to  this  group  has  been  diffused,  in  part  because,  "Washington 
seeks  to  deal  with  complex  organizations  with  a  limUed 
understanding  of  them."^^ 

—The  factor  which  may  have  the  greatest  effect  on  good 

information  sharing  between  the  education  community  and  the 
public  policy  decision  maker  is  the  previously  mentioned 
antagonism  between  the  professional  educator  and  the  politician, 
halperin  notes  that  the  schism  between  the  technical  and 
political  actors  continues  with  educators  commonly  saying  that: 
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"Politicans  have  a  short  term  view  of  the  world;  their  primary 
interest  is  in  their  own  constituency  and  their  narrow 
sectional,  ethnic.,  regional  or  economic  interests;  and  are 
poorly  infonr.ed  on  educational  issues."    The  politicians,  cn  the 
other  hand,  ziy:  "In  order  to  frame  social  policy,  we  need 
facts,  not  generalities.    We  also  need  practical  responses  to 
immediate  problems.    Yet  rarely  do  educators  have  the 
information  we  need  to  make  sound  policy;  and,  educators  ought 
to  know  how  to  communicate,  but  there  are  few  groups  that  speak 
less  clearly,  less  concisely,  and  with  more  obfuscation. 
Instead  of  precise,  comprenensibl e ,  here-and-now  language,  what 
we  get  is  usually  too  olympian,  too  Utopian,  too  abstract,  or 
too  fuzzy  to  be  helpful."^^ 


What  is  clear,  after  a  brief  review  of  the  literature  concerning 
the  use  of  and  need  for  information  by  state  public  policy  decision 
makers,  is  that  the  research  community  cannot  now  identify  mechanisnis 
for  providing  these  political  actors  with  more  useful  information  on 
educational  issues  until  more  is  known  about  the  information 
envircanent. 

As  we  have  noted,  studies  of  the  use  of  Information  by  the 
educational  research  community  have  historically  centered  on  the 
policymakers  in  the  state  and  local  education  agencies.    Studies  of  the 
Information  environment  of  the  state  political  actors  have  addressed 
general  questions  and  have  tended  to  favor  studies  of  the  legislature. 
These  latter  studies  are  even  more  1 imi ted--from  an  educational 
policymaking  perspective--when  we  remeirber  that  the  literature  suggests 
that  education  policy  questions  are  handled  differently  than  other 
policy  questions  by  state  legislatures. 

Additionally,  recent  studies  in  the  education  area  (such  as  those 
by  Rosenthal)  have  centered  on  only  a  portion  of  the  political 
Information  network:  the  legislative  education  committee  members  and 
staff.    The  literature  suggests  that  two-thirds  of  this  network  may 
have  been  overlooked:  the  decision  makers  who  affect  educational  policy 
but  are  not  normally  seen  as  being  part  of  the  system  (such  as 
executive  branch  planning  and  budget  officers  and  legislative  branch 
finance  committee  chairpersons),  and  the  education  opinion  leaders  in 
both  branches. 

While  informational  barriers  to  better,  more  effective,  state 
decisionmaking  exist  in  the  political  community,  there  is  no  evidence 
that  these  barriers  are  inherent  to  our  political  system.    Barriers  to 
providing  adequate  information  for  proper  decision  making  were  also 
noted  in  SEAs  and  LEAs ,  but  have  been  greatly  reduced  by  research 
efforts  which  have  analyzed  these  barriers  and  suggested  methods  to 
overcome  .them. 

What  remains  is  the  problem  of  identifying  the  best  means  of 
providing  useful  statistical  information  to  the  political  decision 
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makers  within  their  unique  environment.    Given  that  infomation  is 
"that  which  reduces  error,"  we  should  conclude  that  providing  better, 
Qore  useable,  statistical  information  to  these  important  political 
actors  will  encourage  improved  educational  pol  icy  decisions  outside  of 
the  SEAs  ,  in  the  same  way  that  providing  oetter  infcn;iation  to  SEA  and 
LEA  leaders  has  improved  their  capacity  to  make  bettor  decisions. 

The  research  opportunity  presented  to  NCES,  then,  is  to:  assess 
the  information  environment  of  the  non-SEA  education  pol  icyi.iakers ; 
review  the  results  of  this  assessment;  based  upon  this  analysis, 
construct  improved  communication  mechanisms  to  overcome  the  problems  of 
legislative  timing,  relevance ,  personal  predisposition,  format, 
relationship  to  constituent  needs  and  peer  thinking;  test  these 
mechanisms;  and  disseminate  successful  approaches  to  the  state 
educational  policymaking  community  and  those  who  serve  them. 


Concl usion 

In  its  1984  study  of  state  response  to  the  recommendations  of  the 
National  Commission  on  Excellence  in  Education,  The  Council  of  State 
Governments  found  that  state  school  leaders  were  taking  the  matter  of 
reform  for  educational  excellence  to  heart  well  before  the  Commission's 
report  was  finalized. 39    in  this  regard  the  Commission's  work  —  and 
the  work  of  many  other  national  taskforces  assembled  since  the 
Commission's  report  was  released      serves  as  an  additional  propelling 
force  for  improvement,  efforts ,  but  is  probably  .not  the  initiator  of  the 
vast  majority  of  state  educational  improvement  efforts. 

If  Anerica  is  at  risk,  and  if  the  reforms  outlined  by  the 
Commission  are  what  are  needed  to  achieve  excellence,  then  there  is 
every  indication  that  the  states  are  already  taking  the  necessary 
actions. 

But  what  was  also  clear  from  The  Council's  study  is  that  state 
officials  are  attempting  to  look  well  beyond  the  Commission's  report. 
Many  states  did  not  take  the  Commission's  report  for  granted  and 
numerous  independent  state  and  local  task  forces  have  been  established 
to  identify  specific  areas  for  improvement  in  each  unique  jurisdiction. 

It  is  well  that  they  have,  for  what  seems  clear  is  that  for 
educational  leaders  to  make  additionol  headway  in  improvement  efforts, 
additional  experience  is  needed  in  communicating  their  "message"  to  the 
state  political  decision  makers.    The  Commission  gave  weight  to  the 
importance  of  political  actors  at  all  levels  of  government,  but  is 
silent  on  the  matter  of  how  opportunities  become  programs  and  needs 
become  budgets.    There  was  every  indication  from  The  Council's  study 
that  the  channels  of  communication       and  the  quality  and  quantity  of 
information  carried  by  them      which  bring  about  informed  educational 
opinion  in  state  decision  makers,  need  additional  study. 

T^e  program  goals  The  Council  suggests  to  NCES  in  this  paper  would 
be  an  ambitious  undertaking,  but  in  electing  to  take  action  In  this 
area  The  Council  expects  that  the  Center  would  be  able  to:  accumulate 
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extensive  knowledge  about  statistical  information  as  it  is  used  by 
non-SEA  executive  and  legislative  policymakers  in  making  decisions 
which  effect  education;  assess  the  meaning  of  the  findings  as  they 
relate  to  the  information,  dissemination  and  research  programs  of  the 
educational  research  community,  the  federal  education  actors,  state 
education  agencies,  local  education  agencies,  and  education  public 
interest  groups;  and  develop  a  model  for  improving  the  communication  of 
statistical  information  to  these  actors. 

The  Council  of  State  Governments  would  look  with  enthusiasm  toward 
a  long-range  plan  developed  by  NCES  which  would  investigate  the  areas 
outlined  above. 

There  may  be  no  greater  waste  than  information  which  goes  unused. 
The  Council  looks  forward  to  working  with  NCES  to  insure  the  widest  and 
best  use  of  statistical  information  by  state  decision  makers. 
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NEEDS  FOR  DATA  IN  EDUCATION 


Considerations  In  Redesigning  the  Elementary 

and  Secondary  Data  Program  of 
the  National  Center  for  Education  Statistics 


Reliable  measures  of  educational  status  and  trends  are  essential  If  we 
are  to  be  able  to  monitor  progress,  understand  change  and  set  policy  in 
education.    That  statement  may  seem  a  truism  applicable  to  any  aspect 
of  the  national  Interest  but  It  Is  especially  true  In  the  educational 
realm.    It  Is  worth  citing  some  of  the  reasons  why  this  is  the  case. 

The  problem  of  deciding  what  data  to  collect  is  especially  acute 
in  education  for  several  reasons.    The  first  is  the  decentralization  in 
this  country  of  both  the  sources  of  information  and  the  structures  of 
decision-making  in  education.    A  second  reason  is  that  educational 
issues  are  intricately  interwoven  with  and  affected  by  a  host  of 
factors  —  economic,  political,  social,  demographic  —  in  the  society, 
so  that  there  are  few  natural  boundaries  to  the  relevant  sources  of 
information  we  may  need  to  draw  upon.    Many  non-educational  agencies 
collect  data  that  are  related  importantly  to  schooling  but  often  they 
collect  them  in  a  form  that  precludes  their  easy  incorporation  into 
educational  analyses. 
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^  Education's  characteristics        *  .spersed  control,  varied 

record-keeping,  diverse  goals,  and  Incompatible  measures  of  results 
serve  both  to  compound  the  data-gathering  problem  and  to  generate  the 
tremendous  need  for  a  systematic,  coordinated  approach  to  a  set  of 
Indicators  of  the  health  of  the  educational  enterprise.    Moreover,  the 
diversity  within  the  country  offers  the  hope  that  reliable  Indicators, 
derived  In  comparable  form  from  different  parts  of  the  country  or  from 
schools  operating  under  contrasting  circumstances,  can  pay  big 
dividends  In  Increased  understanding  of  what  practices  seem  to  work 
well  or  poorly,  so  that  we  have  a  chance  of  not  only  describing  our 
educational  health  but  also  Improving  lt« 

Among  the  key  questions  to  be  addressed  are  who  will  us&  the  data 
for  what  policy  purposes,  and  what  Information  elements  do  they  need  to 
do  the  job?    Further  questions  are  what  aget.^/  or  agencies  should 
collect  the  data,  how  should  they  collect  it,  and  what  role  should  NCES 
play  in  locating,  assembling,  reporting,  and  Interpreting  the 
Information? 

Audiences 

There  are  multiple  audiences  for  data  about  education.  Since 
educational  decisions  are  made  at  state  and  local  levels,  the 
Information  needs  at  those  levels  clearly  must  be  met.    The  "local" 
decision-make. s,  however,  need  data  not  only  about  their  own  state  or 
district  uuu  also  about  the  nation.    They  need  educational  status  and 
trend  data  on  a  multi-district,  multi-state,  national  and  international 
basis  in  jrder  to  compare  their  needs,  efforts,  and  accomplishments 
^  with  those  of  others. 


Several  groups  must  have  national  and  International  data  b<icause 
their  responsibilities  are  national.    They  Include  federal  legislators 
and  administrators,  research  people  examining  the  factors  that 
Influence  educational  pr-»fi:ress  or  such  question*  as  the  Interaction 
between  education  and  economic  development,  and  business  people  whose 
prospects  for  both  manpower  and  markets  are  affected  powerfully  by  what 
happens  In  education,  both  In  the  U.S.  and  abroad. 

There  Is,  then,  a  set  of  neads  for  data  at  the  district,  state, 
national  and  international  levels  that  arise  from  the  responsibilities 
of  diverse  groups  of  people.    There  is  no  way  to  distinguish  the  levels 
of  aggregation  of  data  needed  by  persons  with  broader  or  narrower 
geographic  areas  of  responsibility:    the  broader  picture  provides  an 
essential  context  for  even  tightly  focussed  local  decisions. 

Finally,  the  media  and  the  public  have  a  vital  stake  in  the 
condition  of  education  ~  a  critically  important  "need  to  know."  This 
need  goes  beyond  raw  data  to  a  need  for  analysis  and  interpretation. 
This  latter  requirement  is  a  hard  one  for  any  agency  to  meet  in  a  way 
that  will  be  perceived  as  even-handed  but  one  that  Is  nonetheless 
essential. 


!•    Need  for  A  Program  to  Delineate  Issues 

The  kinds  of  data  needed  obviously  depend  on  the  kinds  of  issues 
to  be  addressed.    The  delineation  of  the  issues  that  the  data  should 
illuminate  is  a  critical  step  and  one  that  needs  explicit  att^^ntion. 
We  m»eH  an  intensive  effort  to  develop  a  taxonomy  of  issues  to  be  dealt 
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with  that  will  In  turn  generate  the  data  to  be  collected*    Second,  we 
need  a  system  for  determining  priorities  within  the  taxonomic 
categories*    Finally,  we  need  to  provide  for  regular  review  and 
modification  of  the  taxonomy  and  priority  matrices* 

Collecting,  analyzing,  and  reporting  data  is  expensive,  despite 
the  powerful  advantages  offered  by  sampling  of  both  respondents  and 
data  elements.    There  must  always  be  trade-offs  leading  to  the 
inclusion  of  some  kinds  of  data  and  the  exclusion  of  others,  with  the 
subsequent  regrets  when  people  find  in  perfect  hindsight  that  some 
critical  Information  is  missing  while  information  of  other  kinds  is  in 
oversupply. 

While  we  will  never  be  able  to  anticipate  all  questions,  we  might 
well  be  able  to  do  a  more  satisfactory  job  of  it  if  the  effort  to 
anticipate  were  itself  made  explicit  and  systematic.    We  need  a 
taxonomy  of  issues  within  which  to  classify  the  questions  to  be  asked, 
which  in  turn  will  generate  a  list  of  the  data  we  need.    The  existence 
of  an  explicit  matrix,  giving  shape  and  structure  to  the  issues  to  be 
examined,  would  help  to  focus  attention  on  the  Important  policy 
questions  at  the  most  critical  time,  i,e.  before  the  design  for  data 
collection  has  been  decided  upon. 

A  recommendation  to  NCES,  then,  is  that  a  project  be  commissioned 
to  develop  a  taxonomy  of  issues  to  be  addressed  by  education  data  and 
related  statistics^    This  project  would  be  of  greatest  value  to  the 
present  redesign  effort  if  undertaken  in  the  summer  of  ]985.    Such  a 
project  could  involve  searching  the  literature  in  education  and  in 
other  fields,  preparing  a  set  of  discussion  papers,  and  convening  a 
working  group  of  knowledgeable  peopl**  to  develop  and  publish  a  proposed 


taxonomy  and  priority  system  tor  widespread  comzpent  and  for  suggestions 
as  to  overlooked  sources  of  data.    The  results  would  be  of  enormous 
valus  to  the  U.S.  Department  of  Education  In  pursuing  the  redesign  of 
its  data  program.    The  taxonomy  would  be  subject  to  periodic  revision 
and  expansion  as  new  questions  are  proposed  and  defined  In  future 
years. 


An  Interim  Working  Set  of  Issues 

In  the  absence  of  the  results  of  a  specific  effort  to  delineate 


Issues,  we  may  turn  to  useful  statements  now  available  to  guide  our 


thinking.    An  excellent  exa^^.ple  Is  the  set  of  Issues  developed  In  1983 
as  a  guide  to  the  reformulation  of  the  National  Assessment  of 
Educational  Progress.*    Excerpts  from  the  pertinent  section  appear 
below: 


Policy  Issues  NAEP 
Should  be  Able  to  Address 

It  seems  clear  that  NAEP  must  now  serve  a  wide 
audience  with  diverse  needs.    Criticism  of 
NAEP  In  the  past  has  unde  rscored  Its  failure 
to  be  responsive  tc  policy  needs  (Wlrtz  & 
Lapolnte,  1982;  Milrod,  1980;  Wiley,  1981; 
Sebrlng  &  Boruch,  1982).    What  are  some  of  the 
Isues  that  NAEP  should  focus  on  as  It 
reorganizes  to  meet  the  challenges  of  the 
eighties? 

Among  the  variety  of  pressing  Issues,  three 
general  policy  areas  stand  out  which  should  be 
addressed  by  NAEP  because  they  require 
reliable  data  on  student  competencies  and 
achievement:    student  competencies  as  they 
relate  to  national  concerns;  student 
achievement  and  attitudes  i^a  they  relate  to 
human  resource  needs;  and,  student  achievement 


Messlck,  S.,  Beaton,  A.,  &  Lord,  F.    National  Assessment  of.  ) 
Educational  Progress:    A  New  Design  for  a  New  Era.    Princeton,  N.J.: 
Educational  Testing  Service,  March,  1983,  pp.  11-15. 
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as  It  relates  to  school  effectiveness.  In 
addressing  these  Issues  NAEP  must  not  only  be 
able  to  provide  a  national  overview,  but  must 
also  be  relevant  to  state  and  local  concerns 
—  not  for  the  purpose  of  needless  comparisons 
among  states  or  school  districts  but  to  assist 
Individual  states  and  localities  In  meeting 
their  goals  and  objectives. 

National  Concerns 

Since  NAEP*s  inception,  the  federal  government 
has  designed  and  implemented  education 
policies  to  provide  equal  educational 
opportunity  to  all  citizens  and  to  assure  that 
young  adults  would  be  able  to  contribute  to 
society  in  terms  of  both  productivity  and 
participation  in  the  democratic  process.  The 
government  clearly  understands  that  an 
educated  populace  is  a  fundamental  requirement 
for  the  nation's  political  and  economic 
well-being.    A  majcr  responsibility  of  NAEF 
should  be  to  provide  information  for 
governmental  and  educational  policymakers  on 
the  effects  of  their  efforts  and  to  act  as  an 
-early  warning  system-  of  potential  problems. 

At  a  minimum,  NAEP  data  should  be  relevant 
to  the  following  kinds  of  questions: 

Are  today's  students  learning  the  skills 
necessary  for  productive  functioning  in 
America  in  the  1980s?    The  19908?    The  year 
2000?  .  .  . 

Are  students  in  urban,  suburban,  and  rural 
schools  all  being  adequately  prepared? 

Are  public  and  private  school  children 
equally  well  prepared? 

Do  children  have  access  to  programs 
preparing  them  to  deal  with  the  computer 
age? 

Are  minority  and  disadvantaged  youngsters 
being  so  prepared? 

What  types  of  programs  or  allocations  of 
resources  seem  to  make  a  difference  for 
disadvantaged  and  minority  students? 

Are  children  from  limited-English-speaklng 
homes  being  provided  the  niicessary  skills? 


7i7- 

705 


Do  students  who  have  received  special 
services  under  federal  or  state  programs 
perform  better  than  similar  children  who 
have  not  had  access  to  those  programs? 

Do  students  leave  formal  education  with 
positive  attitudes  toward  productive  work? 

Human  Resource  Issues 

The  federal  government  is  concerned  with  the 
flow  of  human  resources  to  assure  a  work  force 
competent  to  function  in  an  advanced 
technology  society  and  the  necessary  military 
personnel  to  protect  American  interests • 
Planning  for  human  resource  deployment  is  a 
complex  process  that  requires  reliable 
information  on  young  people's  competencies, 
training,  and  attitudes...* 

In  the  pact  we  have  vacillated  between  feast 
and  famine  in  critical  personnel  areas. 
NAEP  should  assist  governmental  and 
educational  policy  planners  by  contributing 
information  on  the  following  kinds  of 
questions: 

What  are  the  career  goals  of  high  school 
students? 

What  are  the  attitudes  of  today's  youth 
toward  the  military?    toward  business? 

To  what  degree  do  students  with  access  to 
science  and  high  technology  curricula  choose 
careers  in  science  more  than  those  with  no 
such  experiences?  - 

Are  we  preparing  youth  to  meet  the  human 
resource  needs  in  the  health  sciences?  the 
humanities?  teaching? 

Are  vocational/occupational  programs 
equipping  students  with  the  skills  they  need 
to  function  in  the  work  place? 

School  Effectiveness 

School  administrators  are  faced  with  rising 
f^ts  and  multiple  demands  on  limited 
rv   jurces.    They  must  choose  among  a  host  of 
competing  interests.    Achievement  data,  to  be 


( 

most  useful y  should  be  tied  to  other 
information  to  guide  policymakers  in  deciding 
how  they  might  best  organize  their  programs 
and  disperse  their  funds.  Although 
achievement  is  influenced  by  rany  factors  — 
some  school  related ,  others  beyond  the 
school's  control  —  test  data  are  one  measure 
of  the  effectiveness  of  schools.  Holding 
other  variables  constant ,  what  factors  within 
the  purview  of  school  administrators  appear 
most  likely  to  contribute  to  increased 
achievement?    How  can  NAEP  assist  state  and 
local  policymakers  to  improve  schooling? 

If  NAEP  is  conceived  not  merely  as  a  social 
Indicator,  but  as  a  tool  to  Identify  problems 
and  suggest  areas  of  potentially  productive 
research  concerning  educational  progress,  NAEP 
should  attempt  to  provide  data  that  address 
the  following  kinds  of  policy  Issues: 

How  do  pupil/teacher  ratios  appear  to  relate 
to  achievement? 

Do  students  with  preschool  and/or 
kindergarten  experiences  seem  to  perform 
better  than  those  without  such  programs? 

How  do  particular  curricular  approaches 
relate  to  student  achievement  In  reading? 
writing?  math? 

What  are  the  relationships  of  in-service 
training  programs ,  teacher  turnover  rates, 
and  teacher  competency  requirements  to 
student  performance? 


The  NAEP-related  list  of  questions  is  not  sufficiently  elaborated 
to  serve  the  broad  requirements  of  the  NCES  redesign.    As  an  obvious 
example,  it  omits  questions  about  the  relative  effectiveness  of 
education  in  this  country  vls-a-vls  others.    A  taxonomy  of  questions 
should  include  questions  about  how  education  is  faring  not  only  as 
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compared  with  education  in  previous  years  but  also  as  compared  with 
education  In  other  lands.    Comparisons  of  student  accomplishment  In  the 
United  States  with  that  elsewhere,  accompanied  by  Information  about 
differences  In  educational  practices  associated  with  different  results, 
can  not  only  tell  us  how  well  we  are  **competlng,-  It  can  also  help  us 
raise  our  sights  in  areas  where  others  may  be  doing  better  and  lead  us 
to  examine  eHncatlonal  practices  elsewhere  that  seem  to  be  related  to 
achieving  better  or  worse  results. 

2.    General  Design  Issues 

A  clear  mapping  of  the  questions  to  be  answered  from  the  data  must 
be  followed  by  a  decision  as  to  a  strategy  for  gathering  the 

statistics.    The  NCES  activity  is  obviously  not  conducted  in  a  vacuum.  ) 

Many  data-collection  programs  of  other  agencies,  public  and  private, 

gather  information  that  is  directly  or  indirectly  relevant  to 

educational  issues.    In  the  single  area  of  "educational  outcomes,**  even 

a  partial  listing  of  large  data  bases  that  contain  information  derived 

from  tests  given  in  the  U.S.  contains  over  two  dozen  entries: 

Precollege  Modal 


Age 


National  Assessment  of  Educational  Progress  (NAEP) 


9 


National  Assessment  of  Educttlonal  Progress  (NAEP) 


13 


Secondary  School  Admission  Test 


14 


^  Metropolitan  Achievement  Tests 


16 
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Iowa  Tests  of  Educational  Development  16  . 

NCES  1980  High  School  &  Beyond  (HS&B)  Sophomore  Cohort  16 

College  Board  Prellninary  Scholastic  Aptitude  Test  17 

NAEP  17 

Armed  Services  Vocational  Aptitude  Battery  17 

American  College  Testing  Service  18 

NCES  1980  Senior  Cohort-Base  Year  Survey  18 

Transcripts  of  High  School  Grade  (from  HS&B)  18 

CEEB  Admissions  Testing  Program  (Scholastic  Aptitude 
Test,  Achievement  Tests,  Advanced  Placement 

Examinations)                                                      ,  18 

High  School  Equivalency  Test  19 

College  and  Beyond 

Cooperative  Institutional  Research  Program  19 

NCES  1980  HS&B  Senior  Cohort— First  Followup  20 

NCES  1980  HS&B  Sophomore  Cohort — Second  Followup  20 

NCES  Higher  Education  General  Information  Survey 

(HEGIS)  20 

Graduate  Record  Examinations  22 

National  Teacher  Examinations  22 

Undergraduate  Academic  Transcripts  (from  HS&B)  (17  to  22) 

NCES  1980  HS&B— Senior  Second  Followup  22 

NCES  Recent  College  Graduate  Survey  22 

NRC  Survey  of  Doctorate  Recipients  26 
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Other  surveys  that  are  pertinent  Include  those  that  are  specialized  by 
subject  area  (e.g.  the  RTI  National  Science  Survey  for  ages  6-12),  those 
that  are  International  In  scope  but  Include  the  U.S.  (e.g.  the 
International  Surveys  of  IAEA),  and  those  that  provide  data  only  about 
other  countries  (e.g.  the  equivalent  of  our  NAEP  program,  conducted  In 
Great  Britain).    Still  others  that  have  developed  large-scale  longitudinal 
data  bases  over  extended  time  periods »  were  sponsored  by  the  U.S. 
Department  of  Labor  In  order  to  track  educational  and  labor  force 
activity.    (These  are  found  in  the  DOL  National  Longitudinal  Surveys  (NLS) 
of  Labor  Market  experience  and  the  Continuous  Longitudinal  Manpower  Survey 
(CLMS).)    Just  developing  (and  maintaining)  a  good  catalog  of  sources 
would  help. 

Trying  to  merge  these  data  sets  is  a  daunting  challenge  but  an 
activity  that  should  be  studied  and  tried  at  least  experimentally.  A 
system  of  planned  "linking  sections"  common  to  different  data  bases 
might  prove  feasible  and  helpful.    Even  if  a  complete  merging  is  not 
feasible^  some  useful  dimensions  of  comparability  using  subsets  of  data 
may  be  open  to  discovery  and  use.    At  least  it  should  be  possible  in 
the  course  of  such  a  study  to  develop  good  documentation,  available 
centrallyt  about  the  comparability  of  the  several  files,  including 
mundane  but  essential  facts  such  as  whether  or  not  the  data  can  all  be 
run  on  the  same  computer!    Such  documentation  would  in  itself  be 
extremely  useful* 

The  list  includes  examples  of  data  from  both  governmental  and 
non-governmental  agencies.    NCES  already  arranges  to  receive  most  of 
tiie  pertinent  data  from  the  government  agencies.    The  statistical 
series  produced  by  non-governmental  organizations  in  some  cases  are 
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carefully  maintained  and  are  capable  of  Illuminating  special  areas 
within  the  particular  sphere  of  interest  of  the  private  organization. 
Cases  In  point  are  the  data  sets  about  college  or  graduate  applicants » 
their  test  scores  and  their  educational  histories  that  are  collected 
routinely  by  agencies  like  the  American  College  Testing  Program,  the 
College  Board  and  Educational  Testing  Service*    The  educational 
significance  of  these  data  In  the  public  mind  became  dramatically 
evident  In  the  1970*8  when  the  persistent  decline  In  the  mean  scores  of 
SAT  takers  was  first  noted*    NCES  already  draws  on  some  of  these 
sources  of  test  data  for  their  Information  on  outcomes.    A  further  step 
might  be  advance  Joint  planning  of  Issues  that  could  be  explored  more 
effectively  through  cooperative  arrangements  similar  to  the  agreements 
with  SE^i's  or  to  existing  Interagency  agreements 
within  the  Federal  Government. 

The  thicket  of  problems  becomes  even  thornier  when  one  goes  beyond 
data  sets  in  a  single  broad  domain  —  educational  outcomes  —  and 
Includes  the  many  areas  touched  on  in  current  population  surveys  by  the 
Census  Bureau  and  workforce  surveys  by  the  Department  of  Labor*  Since 
the  information  in  these  data  sets  was  not  gathered  on  similar  samples 
by  asking  a  consistent  set  of  questions ,  the  Job  of  NCES  In  trying  to 
bring  it  together  in  relation  to  education  issues  is  extremely 
difficult*    The  ideal  (from  one  standpoint)  of  achieving  complete 
comparability  across  data  sets  is  impractical*    The  basic  need  to 
maintain  continuity  of  long-running  data  sets  is  by  itself  a  major 
deterrent  to  precipitate  change*    Nonetheless,  efforts  should  obviously 
be  made  to  remove  unnecessary  barriers  to  our  ability  to  pool  data 
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across  agencies.    The  present  juncture »  when  NCES  Is  In  the  redesign 
process,  would  seem  to  be  a  good  time  to  explore  the  presently 
attainable  degree  of  planned  compatibility  of  efforts  without 
Jeopardizing  the  unique  needs  of  each  participating  agency. 

Frequently  one  finds  that  two  surveys  Include  questions  Intended 
to  represent  a  whole  complex  of  information  describing  a  construct  of 
common  Interest,  suih  as  socio-economic  status,  but  have  selected 
different  questions.    It  would  be  worthwhile  for  an  Interagency 
authority  such  as  0MB  to  study  the  extent  to  which  the  answers  to 
different  questions  can  be  taken  as  valid  surrogates  for  the  broader 
construct.  , 

Notwithstanding  the  serious  obstacles  to  attaining  compatibility 
across  data  flies,  we  recommend  that  NCES  take  the  lead  in  explorlng^ 

) 

with  other  agencies,  public  and  private,  the  feasibility  of  achieving 
greater  compatibility  among  data  sets.    An  effort  should  be  made  to 
Increase  compatibility  In  the  short  term  where  possible  or  over  a 
longer  period  where  that  Is  required.    It  may  be  that  some  highly 
desirable  steps  toward  eliminating  redundancy  of  effort  that  cannot  be 
completed  in  the  near  future  could  be  accomplished  in  5,  10  or  15 
years  if  started  now. 

3.    "What"  Studies  and  "Why"  Studies 

No  matter  how  successfully  NCES  may  be  able  to  draw  upon  extant 
data  bases  to  meet  its  needs,  it  will  still  need  to  make  a  very 
extensive  primary  collection  effort  of  its  own  for  several  reasons:  to 
fill  In  the  gaps  in  some  areas,  to  acquire  data  in  a  form  compatible 
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with  Its  other  data  elements,  or  to  fulfill  Its  role  as  the  principal 
data  source  In  educational  areas  central  to  the  proposes  cf  NCES, 

Many  of  the  statistics  collected  (e.g.  per  pupil  expenditure  in 
public  schools  by  state)  are  facts  that  have  face  validity  as  Important 
In  their  own  right.    They  answer  legitimate  questions  of  "what  Is." 

The  statistics  on  "what  Is"  are  more  useful  In  answering  questions 
about  present  conditions  than  In  suggesting  how  or  why  those  conditions 
came  about,^    All  too  often,  people  Juxtapose  two  or  more  sets  of  data 
about  disparate  conditions,  find  some  Instances  of  apparent 
correspondence,  and  Infer  a  causal  connection.    The  cross-sectional 
data  of  annual  surveys  are,  of  course,  poor  bases  for  causal  Inference. 
Much  better  for  answering  "why"  questions  are  the  kinds  of  data 
gathered  In  periodic  studies  such  as  the  National  Longitudinal  Study  of 
High  School  Seniors  of  1972  (NLS)  and  the  High  School  and  Beyond  Study 
of  1980  (HS&B). 

The  large  scale  longitudinal  studies  are  proving  to  be  critical  in 
illuminating  issues  of  public  policy,  since  they  provide  a  basis  for 
tracing  the  later  correlates  of  earlier  student  experiences,  and  they 
do  so  in  the  context  of  a  wealth  of  background  information.  The 
background  data  —  about  financial  support,  interests,  subjects 
studied,  extra-curricular  activities,  and  so  on  —  help  in  interpreting 
the  meaning  of  changes  in  attitude  or  in  student  learning  or  in 
decisions  to  continue  or  to  drop  out,  or  in  changing  Job  aspirations, 
both  in  general  and  differentially  by  such  variables  as  sex  or  race. 
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We  endorse  strongly  the  view  that  the  longitudinal  studies  are  a 
uniquely  valuable  educational  resource  and  urge  that  they  be  designed 
as  a  long-term  and  recurrent  element  In  the  NCES  data-gathering  system^ 
Insofar  as  possible,  regular  long-term  funding  expectations  (or, 
ideally,  commitments)  should  be  established  and  broadly  announced  so 
that  other  agencies  could  reaonably  anclclpate  answering  their 
questions  on  the  basis  of  a  continuing  data  series  rather  than  feeling 
compelled  to  establish  duplicative  efforts. 

Both  the  NLS  and  HS&B  studies  trace  the  progress  of  students  from 
the  high  school  years  forward.    In  order  to  Increase  our  understanding 
of  what  Is  happening  In  the  pre-college  years  and  why  It  Is  happening, 
we  need  a  companion  study  that  begins  In  the  pre-school  years  and 
follows  pupil  progress  through  the  grades,  eventually  linking  up  with 
the  HS&B  sample  in  secondary  school.    We  urge  that  a  ''Preschool  and  ' 
Beyond**  longitudinal  study  be  instituted  by  NCES  as  early  as  possible. 
Such  a  study  could  be  instituted  as  a  stand-alone  effort  or  possibly 
created  as  a  longitudinal  sub-study  within  NAEP.    Ideally  it  should  be 
undertaken  on  a  broad  national  scale  but  if  that  approach  is  too 
expensive,  thought  could  be  given  to  the  possibility  of  mounting  it  in 
a  sample  of  cooperating  states* 

Data  and  Information 

A  legitimate  question  is  how  far  NCES  should  go  beyond  gathering  and 
reporting  raw  data  by  providing  the  analysis  and  interpretation  that 
turn  data  into  information. 

; 
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In  this  country  generally »  the  dramatic  improvement  of  information 
processing  technologies  is  likely  to  lead  to  a  sharp  increase  in  the 
volume  of  data  recorded »  manipulated  and  presented.    We  will  have  to  be 
veiy  deliberate  in  our  procedures  to  avoid  swamping  audiences  with 
undigested  data  ''because  it  is  there."    The  quality  of  synthesis  and 
interp'-  *-ation  will  have  to  keep  pace  if  we  are  to  realize  the  benefits 
of  collsccmg  the  data  in  the  first  place. 

It  is  our  impression  that  at  present  the  bulk  of  NCES's  activity 
is  d'svoted  to  providing  data.    It  is  our  further  impression  that  & 
growing  component  of  NC£S*s  worh  is  in  the  areas  of  analysis  and 
interpretation,  through  visual  presentation  and  commentary  in  Ihe 
Condition  of  Education,  through  the  new  publication  on  Indicators ,  and 
through  a  variety  of  special  r  oorts  on  particular  topics.    We  applaud 
the  shift  in  emphasis  toward  interpretation  and  encourage  a 
continuation  in  tlie  same  direction. 

We  believe  also  that  a  strong  effort  should  be  made  to  encourage 
recognition  of  authorship  of  NCES*s  interpretive  commentaries 
another  trend  characteristic  of  recent  years  and  one  that  could  be 
carried  still  further.    SigneJ  analyses  carry  with  them  appropriate 
professional  recognition  for  staffs  with  concomitant  benefits  in  morale 
and  career  advancement.    They  also  create  at  least  some  small 
theoretical  distance  between  the  responsibility  attributable:  *'o  the 
author  versus  the  agency,  even  though  in  times  of  crisis  that  distance 
i    usually  very  slight  except  in  a  purely  academic  institution.  * 
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General  Issues  of  Strategy 

Some  of  the  other  strategic  Issues  to  which  NCES  Is  no  doubt  giving 
attention  In  Its  review  Include: 

The  periodicity  of  surveys  and  creation  of  public  awareness 
of  the  schedule  for  collection  of  annual,  biennial, 
decennial,  etc.  data 

Allocation  of  resources  among  cross-sectional  and 
longitudinal  studies 

Proportion  of  budget  allocated  to  domestic  and  International 
surveys 

Reliance  on  NCES's  own  efforts  versus  dependency  on  data 
collected  by  others 

Extent  to  which  data  drawn  from  other  agencies  will  be  based 
on  cooperative  pre-planning  versus  serendipitous  discovery 

Desirability  of  creating  an  Interagency  mechanism  for 
coordinating  data  collection  plans 

The  matter  of  how  to  encourage  widespread  use  of  the  NCES  data  deserves 
intensive  review.    Possibilities  such  as  more  extensive  use  of  networking 
to  make  the  data  readily  available  need  continuous  review  as  the 
available  technology  advances.    Obstacles  to,  and  techniques  for 
encouraging,  public  use  of  data  tapes  should  b^  explored,  as  should 
mechanisms  for  sharing  1-  jight  and  problems;  e.g.  creation  of  on  AERA 
Special  Interest  Group  for  people  using  the  High  School  and  Beyond  data 
sets,  or  creation  of  a  consortium  of  data  base  users. 

4.    Specific  Design  Issues 

The  foregoing  comments  have  been  concerned  with  general  issues  nf  design. 
A  more  specific  set  of  issues  is  posed  if  one  asks  a  question  like 
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"what's  wrong  with  the  data  W3  collect  now?    This  is  essentially  t^e 
approach  taken  by  Cooke,  Glnsburg  and  Smith  in  their  useful  paper** 

Anyone  who  has  worked  wit>^  the  NCES  data  or  virtually  any  other  data 
set  will  recognize  and  be  able  to  add  to  the  deficiencies  reported  in 
"The  Sorry  State  of  Education  Statistics. -    The  best  way  to  improve  the 
situation  is  a  question  of  another  order. 

Many  of  the  difficulties  noted  by  Cooke,  Ginsburg  and  Smith  stem 
from  NCES*s  dependence  on  the  50  states  to  collect  and  report  data 
consistently.    The  cooperative  arrangement  with  the  SEA*s  has  obvious 
advantages.    Some  agreement  on  common  definitions  seems  essential, 
however,  if  the  aggregated  data  are  to  be  meaningful.    It  is  suggested 
that  NCES  work  through  the  Council  of  Chief  State  School  Officers  to 
procure  comparable  data  from  the  SEA*8»    This  need  not  disturb  the 
individual  state's  internal  definitions  of  variables  such  as  attendance. 
A  viable  procedure  might  be  to  arrange  for  access  to  all  of  the  raw  data 
(e.g.  number  of  enrolled  children,  number  absent  with  excuses  and  without 
excuses,  etc.)  from  which  the  SEA  and  NCES  (or  CCS SO  for  NCES)  could 
derxve  statewide  statistics  to  fit  their  own  definitions.    It  would  seem 
appropriate  for  NCES  to  stand  ready  to  Provide  technical  assistance  to 
states  that  request  consultation  on  the  hs*at  ways  of  collecting  and 
presenting  their  data. 
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Some  problems y  like  students'  tendencies  to  overstate  their  course 
load,  probably  cannot  be  eliminated.    It  Is  suggested,  however,  that  a 
continuing  3?rles  of  studies  be  undertaken  of  characteristic  student 
response  bias  In  key  areas  as  a  basis  for  deriving  response  adjustiaent 
coefficients.    These     .efficients  could  be  applied  systematically  to 
provide  more  valid  estimates  of  the  true  situation.    The  studies  needed 
to  obtain  estimates  of  re::ponse  bias  would  be  Intensive  small-scale 
studies  that  would  need  to  be  repeated  perhaps  every  5  or  10  years, 
depending  on  the  Index.    In  some  cases  where  the  discrepancy  between  the 
response  and  the  factual  situation  seemed  extreme  (e.g.  where  80  percent 
of  high  school  seniors  report  that  they  have  taken  a  geometry  course 
compared  with  25  percent  shown  on  transcripts)  the  most  useful  result 
would  be  clues  as  to  how  to  revise  the  question  rather  than  calculation 
of  a  response  adjustment  coefficient. 

***** 

ETS  Is  well  aware  that  many  of  the  suggestions  made  above  may 
already  be  well  represented  In  the  procedures  or  the  plans  of  NCES.  We 
decided  that  In  this  paper  we  should  err  on  the  side  of  Inclusiveness  at 
the  risk  of  redundancy.    We  will  be  glad  to  clarify  points  that  need 
further  explanation  or  to  elaborate  on  Ideas  that  may  need  exploration  In 
detail. 


718 


730 


( 


t; \v.  i.lti !!•  ran  CI il'-ic! i-m;s.m".l-k(  >\ W  id  i 


r 


I"'.jrp./..MiijI  Center 

Same  l,nui>.  \(i>MHin  n.ViiJ-~j^*^ 


June  U,  1985 


Mr.  Emerson  J.  Elliott 
Administrator 

United  States  Department  of  Education 
National  Center  for  Education  Statistics 
1200  19th  St.  NW 
Washington,  DC  20208 


Dear  Mr.  Elliott: 

The  elementary  and  secondary  schools  spoiisored  by  congregations  of  The 
Lutheran  Church — Missouri  Synod  are  interested  in  cooperating  in  the  re-design 
of  the  education  data  program  provided  by  the  national  center  for  education 
statistics.    At  this  time  we  are  not  providing  a  formal  paper  for 
consideration  in  the  first  synth^i^siSy  but  we  wanted  to  be  sure  you  were  aware 
that  we  wish  to  Join  in  the  re-design  and  in  the  program  itself. 


It  is  helpful  for  us  to  know  approximately  how  many  non-public  schools  exist 
at  what  levels  (preschool,  elementary  or  secondary)!  how  many  children  they 
serve,  and  how  many  teachers  and  administrators  serve  them.    It  is  also 
helpful  for  us  if  we  can  separate  The  Luthercm  Church—Missouri  Synod  schools 
from  the  other  schools  In  your  non-public  school  survey,  and  that  we  can 
compare  their  responses  with  those  of  the  other  church  and  non-church  oriented 
private  schools.    It  would  also  be  helpful  if  we  could  compare  data  with  the 
public  schools. 

Although  we  collect  and  disseminate  rather  extensive  data  on  the  schools  of 
The  Lutheran  Church — Missouri  Synod,  receiving  specific  reports  from  over  95X 
of  our  schools,  we  are  very  interested  in  cooperating  in  this  venture.    We  are 
eager  to  provide  data  for  important  surveys »  such  as  tLe  private  school 
survey.    In  return  we  appreciate  receiving  the  results  of  that  survey  so  that 
we  can  continue  to  improve  our  schools. 

It  is  important  that  the  number  of  teachers  in  our  schools  be  counted  in  the 
survey  of  teacher  demand  and  shortage.    Frequently  the  non-public  school 
teacher  demand  and  shortage  is  quite  different  than  that  found  in  the  public 
schools.    Information  comparing  both  types  of  school  would  be  appreciated. 

One  of  the  growing  agencies  in  the  schools  sponsored  by  our  church  is  extended 
daycare.    This  may  become  a  service  offered  by  public  schools  in  the  near 
future  if  federal  financing  should  become  available.    I  believe  that 
information  covering  tho^e  schools  which  provide  extended  daycare  before  and 
^  after  school  would  be  important  to  be  added  to  your  statistics. 
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Mr.  Emerson  J.  Elliott 
June  11,  1985 
page  2 

If  I  can  help  any  further  or  if  you  have  any  questions  about  our  data  or  di-a 
collection,  please  feel  free  to  contact  me. 

Serving  the  Master  Teacher, 


Carl  J*  Moser^  Associate  Secretary 
Elementary  and  Secondary  Schools 


c.c.  Dr.  Vic  Constlen 
Dr.  James  Boldt 


ERIC 


720 


732 


( 


DATA  ON  VOCATIONAL  EDUCATION: 
Problems  and  Recommendations 


prepared  for 
National  Center  for  Education  Statistics 
U.S.  Department  of  Education 


by 

The  National  Center  for  Research  in  Vocational  Education 
The  Ohio  State  University ^ 

1960  Kenny  Road 
Columbus,  Ohio  43210-1090 

June  20,  1085 


ERIC 


733 

721 


INTRODUCTION 


The  Carl  D.  Perkins  Vocatioral  Education  Act  (P.L.  98-524)  continues  the 
information  systems  establisnod  by  the  1976  amendments  to  the  Vocational  Educa- 
tion Act  of  1963  (P.L.  94-482):  a  vocational  education  data  system  and  the 
National  Occupational  Information  Coordinating  Committee.  By  these  continu- 
ations Congress  has  reiterated  its  long-standing  interest  in  better  information 
both  to  assess  the  effects  of  the  federal  role  in  vocational  education  and  to 
improve  the  working  of  the  labor  market.  Any  information  systems  established 
for  vocational  education  must  attempt  to  respond  to  these  two  objectives,  but 
it  Is  doubtful  if  any  one  system  can  do  both. 

The  initial  attempt  to  fashion  such  a  system  by  the  National  Center  for 
Education  Statistics  (NCES)  failed  because  it  tried  to  do  too  much.  The  origi- 
nal Vocational  Education  Data  System  (VEDS)  attempted  to  provide  information 
both  for  policy  and  for  labor  market  purposes  at  a  level  of  detail  that  local 
and  state  sources  could  not  supply  with  acceptable  accuracy.  The  internal  and 
year-to-year  inconsistencies  In  the  data  assembled  by  VEDS  led  the  Office  of 
Management  and  Budget  to  stop  the  collection  of  1983-84  data. 

NCES  is  currently  trying  to  design  a  new  "national  vocational  education 
data  reporting  and  accounting  system"  which  will  comply  with  the  mandates  In 
the  Perkins  Act  (Sec  421).  These  mandates  are  much  the  same  as  those  in  the 
1976  amendments  except  there  is  a  greater  emphasis  on  special  populations  and 
on  the  use  of  sampling  to  collect  data.  This  paper  Is  intended  to  assist  NCES 
in  this  process.  It  reflects  the  ideas  of  those  staff  members  of  the  National 
Center  for  Research  in  Vocational  Educationl  who  have  worked  most  closely 
with  the  available  national  data  on  vocational  education.  First  the  problems 
that  the  original  VEDS  encountered  are  reviewed.  The  paper  then  presents 
recommendations  for  improving  the  operation  of  future  systems  and  the  utility 
of  the  data  they  collect. 

Problems  with  the  Old  VEDS 

A  1979  report  by  the  National  Center  reviewed  the  early  implementation  of 
VEDS  and  concluded: 
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VEDS  future  is  still  uncertain. 

...  to  the  degree  VEDS  is  implemented,  vocational  educators  and 
decision-makers  at  every  level  will  have  a  knowledge  of  who  enrolls 
in  vocational  education  programs,  what  happens  to  them  afterward, 
and  what  it  costs  in  the  kind  of  detail  long  needed,  but  never 
before  available.  The  extent  to  which.. it  is  implemented  will 
depend  upon  the  decisions  of  thousands  of  local  and  state  adminis- 
trators as  they  attempt  to  supply  information  in  the  form  that  VEDS 
requires  (pp.  64-65) 

By  1984  the  uncertainty  had  been  removed.  VEDS  as  NCES  had  originally 
tried  to  implement  it  was  stopped  by  0MB.  VEDS  had  generated  data  at  a  level 
of  detail  not  previously  available,  but  the  dcta  were  not  consistent  or 
credible.  Comparisons  of  VEDS  data  to  other  sources  yielded  in  a  few  states 
vocational  enrollments  that  exceeded  total  secondary  enrollment.  Year-to-year 
changes  within  states  in  program  enrollments  of  50  to  100  percent  were  not 
uncommon.  It  would  be  easy  to  attribute  the  poor  quality  of  these  data  to 
resistance  or  ineptitude  among  the  data  providers  but  more  fundamental  problems 
underlie  most  of  these  reporting  difficulties. 

(  Definitions 

The  primary  difficulty  at  the  secondary  level  is  definitional.  What 
criteria  should  be  used  to  define  vocational  students?  The  quick  answer  is 
course  enrollment:  Students  who  take  vocational  courses  are  vocational 
students.  By  this  definition,  however,  virtially  all  secondary  students  are 
vocational.  (Campbell,  Orth  and  Seitz  (1981)  have  shown  that  over  three- 
fourths  (78  percent)  of  students  take  one  or  more  courses  designed  to  teach 
skills  for  paid  employment.  If  consumer  and  homemaking  and  industrial  arts 
courses  are  included,  over  90  percent  of  students  take  at  least  one  vocational 
course  (Meyer  1981,  NCES  1984). 

Another  technique  frequently  used  is  to  ask  students  to  classify  them- 
selves as  to  their  main  course  of  study.  When  comparison  are  made  between 
self-report  and  other  classifications  made  by  administrators  (Fetters  1975)  or 
from  an  analysis  of  transcripts  (Campbell,  Orth  and  Sftitz  1981)  approximately 
one-third  disagreement  between  the  sources  is  found. 

If  additional  criteria  are  applied  to  course  taking  data,  such  as  total 
number  of  courses,  areas  of  concentration,  and  the  grade  level  at  which  the 
^  courses  were  taken,   it  is  possible  to  distinguish  those  who  appear  to  be 

ER^  723  735 


preparing  for  entry  into  identifiable  occupations  from  those  who  appear  to  be 
taking  voca^iorial  courses  for  exploratory  or  avocational  reasons.  This  is  the 
approach  that  rampbell,  Orth  and  Seitz  (1981)  followed  and  it  enabled  them  to 
iden'Jfy  five  discrete  patterns  of  participation  in  vocational  courses.  These 
patterns  distinguished  between  those  who  seem  to  be  preparing  for  employment 
and  others  who  took  vocational  courses  without  appearing  to  have  employment  as 
an  objective. 

The  Campbell,  et  al.  approach  is  applicable  when  students  have  completed 
or  left  high  school  and  complete  information  is  available  on  the  courses  they 
had  taken.  It  is  less  appropriate  for  classifying  students  while  they  are 
still  in  high  school.  A  student  may,  for  example,  take  agricultural  courses  in 
the  ninth  and  tenth  grade,  switch  to  auto  mechanics  in  his  eleventh  grade  and 
to  carpentry  in  the  twelfth  grade.  Depending  on  when  the  student  was  counted 
in  his  high  school  years,  he  would  be  classified  in  three  different  program 
areas.  The  Campbell  et  al.  decision  rules  would  classify  such  a  student  as  a 
concentrator-explorer— one  who  initially  appeared  to  follow  an  area  of  spe- 
cialization but  who  left  it  to  sample  other  occupational  areas. 

Reporting  System 

A  second  major  problem  the  cid  VEUS  encountered  was  the  varied  and  decen- 
tralized nature  of  the  system  that  generated  the  VEDS  reports.  The  VEDS  forms 
were  distributed  to  the  states.  The  information  that  was  aggregated  and  re- 
ported on  those  forms  was  collected  from  local  educational  agencies  by  a  vari- 
ety of  means.  A  few  states  virtually  duplicated  the  VEDS  forms  and  required 
the  local  agencies  to  complete  them.  Some  states  relied  on  individual  student 
records  which  were  completed  at  the  local  level  and  aggregated  at  the  state 
level.  Most  states,  however,  tried  to  adopt  their  existing  information  systems 
to  supply  the  information  required  by  VEDS.  The  success  of  this  approach 
varied  widely  across  states. 

Relying  on  s'ich  a  decentralized  system  requires  very  good  communication 
from  the  federal  to  the  state  and  from  the  state  to  local  levels.  Even  when 
the  communication  is  good,  there  is  an  inevitable  time  lag  between  the  initia- 
tion of  a  request  at  the  federal  level  and  the  response  at  the  local  level. 
Any  changes  in  the  request,  and  there  were  many  in  VEDS  brief  history,  com- 
pounds the  communication  difficulties.  The   repeated   message  that  National 
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Center  staff  received  when  they  contacted  VEDS  coordinators  in  the  states  was 
to  stabilize  and  simplify  the  system.  Of  the  two  stability  is  probably  more 
important  than  simplification. 

Special  Needs  Populations 

Vocational  educators  have  had  difficulty  in  developing  accurate  ways  to 
identify  disadvantaged  and  handicapped  students  for  reporting  purposes.  These 
difficulties  stem  primarily  from  the  discrepancy  between  the  way  special  popu- 
lations are  served  in  schools  and  the  way  they  are  defined  in  legislation.  The 
Perkins  Act,  for  example,  does  not  limit  the  definition  of  disadvantaged  to 
income.  It  includes  individuals  "who  have  economic  or  academic  disadvantages 
and  who  require  special  se^^vices  and  assistance  in  order  to  enable  them  to 
succeed  in  vocational  education  programs."  [Sec  521(12)].  Even  if  the  defini- 
tion were  limited  to  family  income,  public  schools  are  reluctant  to  request 
such  information.  On  those  occasions  when  it  has  been  requested,  the  schools 
have  encountered  resistance  and  protests.  Consequently  schools  have  had  to 
rely  on  proxies  of  disadvantaged  status,  such  as  eligibility  for  free  or 
reduced  price  school  lunches.  Even  with  such  proxies,  the  names  of  those 
eligible  are  not  widely  shared  and  often  are  not  available  to  the  individuals 
responsible  for  completing  the  local  forms  that  are  aggregated  for  VEDS. 

The  existence  of  an  individualized  educational  plan  should  be  a  clear 
indicator  of  whether  a  student  is  handicapped.  Vocational  administrators  often 
claim,  however,  that  many  handicapped  students  are  mainstreamed  in  vocational 
classes  without  the  teachers  or  the  administrators  ever  being  informed  of  the 
students'  handicaps.  This  is  especially  true  among  learning  disabled  and 
speech  impaired  students  who  constitute  approximately  two-thirds  of  all  handi- 
capped students.  Their  handicaps  are  less  obvious  and  often  less  of  a  detri- 
ment in  vocational  classes.  Furthermore,  by  the  definition  contained  in  the 
Perkins  Act  [Sec  521(15)],  these  students  must  require  special  education  and 
supportive  services  to  succeed  in  regular  vocational  classes  to  be  considered 
handicapped.  A  literal  interpretation  of  this  definition  means  if  they  are  not 
receiving  special  services,  they  should  not  be  reported  as  handicapped. 
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Recommendations 

This  brief  review  of  the  major  problems  encountered  by  the  old  VEDS  argues 
for  a  division  between  data  collected  primarily  for  policy  purposes  and  uata 
for  labor  market  information.  Most  data  for  policy  purposes  can  best  be  col- 
lected with  special  studies  conducted  on  a  sampling  basis.  Accurate  data  on 
program  completers  for  the  Occupational  Information  System,  however,  requires  a 
census,  a  complete  enumeration  of  the  population  of  interest. 

Data  for  Policy 

Policy  questions  are  basically  concerned  with  who  is  served,  how  they  are 
served,  at  what  cost,  and  with  what  effects?  Data  to  answer  these  questions 
can  best  be  collected  with  specially  designed  questionnaires  from  representa- 
tive samples  of  schools.  The  two  on-going  longitudinal  studies  of  NCES  and  the 
one  currently  being  planned  can  provide  much  of  the  needed  data.  Analyses  of 
data  of  this  type  can  provide  far  more  precise  information  on  the  character- 
istics of  vocational  students,  their  secondary  and  postsecondary  educational 
experiences  and  subsequent  work  careers  than  any  aggregate  reports. 

The  use  of  high  school  and  postsecondary  transcripts  to  define  varying 
patterns  of  participation  in  vocational  courses  is  recommended.  Such  a  prac- 
tice will  deal  with  the  definitional  problem  that  plagued  the  old  VEDS.  The 
collection  of  original  data  from  respondents  in  selected  schools  overcomes  the 
difficulties  of  using  the  varied  educational  reporting  systems  in  the  separate 
states  to  generate  the  data* 

Future  longitudinal  studies  should  be  supplemented  to  provide  more  infor* 
mation  on  the  educational  process.  Indicators  of  the  educational  process 
within  vocational  education  could  include: 

•  Student  recruitment,  selection 

•  Sources  of  curriculum 

•  Use  of  class  tii;«e 

•  Relevance  of  equipment  to  that  being  used  by  employers 

•  Contact  with  business  and  industry 

•  Background  of  instructors,  most  recent  experience  in  occupational 
areas  they  teach 

Information  for  some  of  these  indicators  could  come  from  the  students  as  ^ 
well  as  from  teachers  and  administrators.  Cost  information  can  be  obtained 
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from  the  financial  reports  filed  with  the  Office  or  Vocational  *and  Adult 
Education. 


Labor  Market  Information 

Public  vocational  education  is  the  major  source  of  information  on  the 
supply  of  new  workers  for  the  Occupational  Information  System  developed  by  the 
National  Occupational  Information  Coordinating  Committee.  To  provide  this 
information  at  a  level  of  detail  sufficient  for  state  and  local  planning 
decisions  requires  a  census  of  all  students  who  complete  or  leave  vocational 
program  after  attaining  a  competency  level  judged  suitable  for  paid  employment 
in  specified  occupations.  To  attempt  to  provide  these  data  on  a  sampling  basis 
would  require  so  many  primary  sampling  units  that  the  costs  of  collecting  the 
data  would  be  prohibitive. 

It  is  recommended  that  instructors  in  public  vocational  programs  complete 
a  standardized  form  for  each  program  completer  or  leaver.  These  instructors  are 
in  the  best  position  to  make  such  judgments  or.  the  competencies  of  their  stu- 
dents. The  form  the  instructors  complete  should  contain  background  information 
on  the  sex,  age,  race/ethnicity  of  the  students, 2  the  program  area  in  which 
trained  and  whether  or  not  the  individual  attained  a  competency  level  suitable 
for  employment  in  specified  occupations.  Such  a  report  would  deal  with  the 
problem  of  defining  a  program  completer  or  leaver  which  is  especially  trouble- 
some at  the  postsecondary  level.  Most  postsecondary  students  do  not  enter  a 
specified  program.  They  take  one  or  two  selected  courses  to  meet  personal 
needs.    Many  of  them  are  employed  at  the  time  they  take  these  courses. 

The  forms  instructors  complete  would  be  submitted  at  periodic  intervals  by 
local  educational  agencies  to  their  state  offices.  At  the  state  level,  the 
forms  would  be  aggregated  for  use  in  the  state  occupational  information  system 
and  a  cumulative  report  made  each  year  to  NOES.  The  National  and  State  Occupa* 
tional  Information  Coordinating  Committees  would  like  program  completers  to  be 
reported  at  the  six  digit  level  according  to  the  Classification  of  Instruction 
Program  (Malitz  1981)  code.  This  level  does  not  reflect  the  way  most  voca* 
tional  programs  at  the  secondary  and  postsecondary  level  are  offered.  These 
programs  are  designed  to  provide  preparation  for  employment  in  a  number  of 
related  occupations.  To  require  reporting  at  the  six^digit  level  forces 
individuals  to  make  arbitrary  choices  that  cause  unreliability  in  the  data. 
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The  six-digit  level  may  be  appropriate  for  some  short-term  retraining  or 
upgrading  courses,  but  for  most  longer-term  vocational  programs  it  is  too 
specific. 

The  total  number  of  prograns  completers  reported  by  public  vocational 
programs  should  not  be  entered  directly  as  data  on  the  supply  of  skilled 
workers.-  Campbell,  Gardner  and  Winterstein  (1984)  have  found  that  less  than 
half  of  secondary  students  who  complete  extended  vocational  programs  actually 
seek  employment  immediately  after  high  school.  Many  go  on  for  additional  post- 
secondary  education.  The  results  of  this  and  future  research  should  be  used  to 
adjust  the  supply  data  for  the  Occupational  Information  System  so  that  the 
completer  figures  more  accurately  reflect  those  who  actually  seek  employment. 


FOOTNOTES 

1.  In  subsequent  discussion  National  Center  shall  refer  to  the  vocational 
center  and  NCES  to  the  statistical  center. 

2.  These  data  would  be  for  policy  not  labor  market  purposes. 
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Suggestions  For  The  NCES  Redesign  Project 

The  National  Education  Association  (NEA)  is  entering  the  information 
age  with  a. lack  of  information.    In  a  nation  accustomed  co  numberst  this 
statement  seems  absurd.    After  all,  public  and  private  collections  of 
educational  data  exist.    Statistics  bombard  the  education  market  weekly. 
The  public  press  turns  out  bales  of  educational  reports  yearly. 

All  of  this  information  should  provide  a  clear  picture  of  the  status 
of  education  in  this  country.    It  should  provide  sharp  reflectiorc  of  the 
w?iy  education  is  changing.    It  should  also  help  answer  with  increasing 
sophistication  the  many  questions  of  cost,  benefit,  and  quality.  Avail- 
able information,  however,  does  not  reflect  well  the  educational 
landscape. 

Bringing  education  into  sharp  focus  is  as  difficult  today  as  it  was 
twenty  years  ago,     -ae  need  for  a  sharp  focus,  however,  is  perhaps  greater 
today  than  it  was  in  the  past.    Government  regulation  of  education  has 
in-^reased.    State  funding  for  educatiot  has  increased.    The  number  of 
students  enrolled  in  schools  is  increasing.    And  new  measures  to  refort. 
education  are  everywhere  present. 

All  of  these  changes  carry  with  them  a  demand  for  more  and  better 
information  about  education,    let  the  current  supply  of  data  has  not 
kept  up  with  the  demand,  and  educators  have  reason  to  worry.    If  the 
demand  is  not  met,  then  future  policy  will  likely  be  based  on  a  murky 
picture.    Furthermore,  we  will  not  know  with  any  certainty  what  impact 
efforts  to  reform  education  have  had. 

The  redesign  project  of  the  National  Centner  for  Education 
Statistics  (NCES)  offers  a  partial  but  significant  solution  to  the 


Informatloa  problem.    The  Center *s  resources,  capabilities,  and  pro- 
fessional reputation  are  ideally  suited  for  the  data-collection  efforts 
needed  in  education.    Although  the  NEA  does  not  believe  NCES  can  or 
should  solve  all  the  information  problems,  we  do  believe  it  can  solve 
some  of  them.    For  this  reason,  the  NCES  redesign  project  is  of  major 
Importance,  and  the  NEA  is  pleased  to  be  involved. 

NEA  suggestions  for  the  NCES  redesign  of  its  elementary  and 
secondary  education  data  program  are  organized  below  under  five  cate- 
gories suggested  in  NCES  guidelines.    The  categories  are:    Issues  and 
Data  Needs;  Data  Modifications;  Importance  of  NCES  Series;  Data  Deletion; 
and  Relevance,  Quality,  and  Utility. 

Issues  and  Data  Needs 

Today,  our  national  self-perceptions  of  education  are  regularly 
confirmed  or  challenged  by  statistics  on  many  matters.    Whether  the 
meanings  read  into  the  data  are  reasonable  or  fanciful,  the  numbers 
provide  a  basis  for  popular  and  specialized  discussion. 

The  NEA  expects  official  numbers,  especially  those  that  appear  in 
series,  to  play  an  increasingly  prominent  role  in  policy  deliberations. 
Among  the  many  issues  likely  to  be  discussed  in  the  future,  several 
aoted  below  seem  particularly  amenable  to  NCES  collection  efforts. 

Effective  Schools 

Issues  of  quality  education  will  likely  expand  to  include  recent 
effective  schools  research.    Subjects  of  interest  can  be  expected  to 
include  characteristics  of  school  organization,  school  governance, 
school  administration,  public  expectations  for  schools,  federal  and 
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state  regulations,  and  local  policies. 

The  current  NCES  data  program  will  not  provide  sufficient  support  for 
the  effective  schools  issue.    The  following  revisions  should  help 


strengthen  the  data  base: 

o    Add  to  both  the  public  and  private  school  surveys 
data  elements  pertaining  to  the  school  character- 
istics of  organization,  governance,  administration, 
expectations,  regulations,  and  policies.  Suggestions 
for  such  elements  appear  in  Tables  1  and  2  at  the 
conclusion  of  this  paper. 


0    Consider  expanding  the  NCES  program  to  include 
case  studies,  field  studies,  policy  reviews, 
historical  research,  and  additional  surveys  to 
expand  the  scope  and  detail  of  effective  schools 
data. 


Equity 

Since  World  War  II,  numerous  policy  changes  concern  thv^.  i^sue  of 
equity.    School  busing  (to  adjust  the  numbers  of  white  and  black  students) 
and  job  quotas  (to  ensure  the  efficacy  of  affirmative  action)  are  but  two 
examples. 

Equity  issues  pertaining  to  race  arfd  sex  will  likely  persist.  Issues 
pertaining  to  age  and  ethnic  origin  will  likely  grow.    The  following 
suggestions  anticipate  the  demand  for  more  detailed  dati  where  they  are 


not  already  gathered: 

0  Refine  the  variants  of  Spanish  ethnicity  to 
include  Mexican  American,  Puerto  Rican,  and 
Cuban  for  all  NCES  surveys. 


o    Refine  the  variants  of  Asian  ethnicity  to 
include  Pacific  Islanders,  Japanese,  Chinese, 
and  Vietnamese  for  all  NCES  surveys. 
Consider  using  the  U.S.  Census  itea  for 
this  refinement. 

0    Add  the  ethnic  category  of  American  Indian 
and  Alaskan  Native  for  all  NCES  surveys. 
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Public  and  Private  Schools 

A  broadened  perspective  on  schooling  Is  evident  In  current  policy 
discussions.    This  perspective  includes  K-12  schools  In  the  mixed 
public-private  system  of  schooling,  pre-prlmary  schools,  and  adult 
education  and  training  urograms  In  both  public  and  private  sectors. 

This  perspective  raises  many  questions  about  public  and  private 
schools:    how  they  are  similar,  how  they  are  different,  and  what  they 
can  learn  from  each  other.    The  following  redesign  suggestions  antici- 
pate L  continued  and  broadened  public-private  school  debate: 

o    Add  to  the  Sample  Surveys  component  a  Fre<-Primar7 
School  Survey  designed  to  gather  luformation 
about  the  location,  organization,  program, 
governance,  finance,  employees,  and  students  of 
these  schools. 

o    Align  the  data  elements  in  the  Private  School 
Survey  and  Public  School  Survey  so  that  the  two 
surveys  are  comparable.    Specific  suggestions 
for  revisions  appear  in  Tables  1  and  2. 

o  Expard  the  scope  of  data  collected  for  both  the 
private  and  public  school  surveys.  Suggestions 
for  expansion  appear  in  Table  2  concluding  this 
paper. 

o    Add  to  the  Sample  Survey  component  a  survey  or 
to  the  Other  Agency  Data  component  survey  items 
that  track  the  magnitude  and  growth  of  adult 
education  and  training  programs  in  both  public 
and  private  sectors. 

School  Finance 

Limited  resources  require  that  money  be  spent  on  education  wisely 
at  the  local,  state,  rmd  federal  levels.    Current  revenue  and  expenditure 
data  seriously  curtail  the  kinds  of  questions  that  can  be  asked  and 
answers  that  can  be  explored.    Because  the  demand  iior  cost-effectiveness 
studies  will  likely  increase  in  a  period  of  limited  resources  and  fiscal 
restraint,  the  need  for  more  detailed  revenue  and  expenditure  data  will 


( 


grow.    The  following  suggestions  for  NCES  revision  can  ease  the  need 


for  better  fiscal  data: 


o    Provide  greater  revenue  and  expenditure  detail 
for  both  private  and  public  schools.    See  Tables 
1  and  2  for  specific  suggestions, 

o  Add  data  for  incentive  plans  and  salaries  of 
public  and  private  school  administrators  and 
educational  support  personnel. 

Student  Outcomes 


Statistics  are  regularly  published  on  such  fundamental  matters  as 
reading  and  literacy  rates,  achievement  rates,  and  dropout  rates.  The 
inadequacy  of  measures  for  each  of  these  rates  is  well  established  and 
uell  known.    The  following  suggestions  call  for  a  major  revision  of 


student  outcome  data: 

o    Expand  and  standardize  the  definition  of  student 
performance  outcomes  to  include  more  knowledge 
areas.    Consid^.r  such  categories  as  linguistic, 
musical,  logical-mathematical,  spatial,  bodily- 
kinesthetic,  and  personal  knowledge. 


o    Develop  measures  appropriate  for  an  enlarged  view 
of  student  outcomes.    Consider  the  possibility  of 
building  upon  the  diversified  measures  developed 
for  the  National  Assessment  of  Educational 
Progress. 

o    Collect  fall  and  spring  enrollment  figures. 

o    Standardize  definitions  of  dropout,  attendance, 
and  literacy. 

o    Convene  an  advisory  group  to  study  methods  suit- 
able for  measuring  dropout  rates  and  student 
mobility. 


Teaching  Quality 

For  a  number  of  years,  fairly  simple  models  directed  the  collection 


of  data  pertaining  to  teaching  quality.    For  example,  some  models  vere 
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constructed  on  the  metaphor  of  an  assembly  line  with  students  and  proce- 


dures standardized.    Some  models  viewed  students  as  passive  agents  over 
which  teachers  had  absolute  control.    Other  models,  including  those 
underlying  several  reform  proposals,  take  an  economic  view  of  teachers 
and  teaching. 

Accmulated  research  and  the  experiences  of  teachers  indicate  that 

all  of  these  models  misrepresent  reality.    For  this  reason,  the  issue  of 

teaching  quality  will  likely  become  more  complex  as  models  for  thinking 

about  quality  change.    Suggestions  consistent  with  this  change  include: 

o    Add  data  elements  for  each  of  the  following  known 
components  of  effective  teaching:    personal  char- 
acteristics of  teachers,  teacher  competence,  teacher 
performance,  student  learning  experience,  student 
learning  outcomes,  teacher  credentials,  school 
context,  characteristics  of  students  as  a  class, 
and  characteristics  of  students  as  individual 
learners.    Suggestions  for  data  elements  appear 
in  Tables  1  and  2. 

o    Consider  convening  an  advisory  panel  to  develop 
and  refine  over  time  measures  of  teaching 
effectiveness. 

o    Consider  expanding  the  NCES  program  to  include 

case  studies,  field  studies,  policy  reviews, 

historical  research,  and  additional  surveys  tc 

expand  the  scope  and  detail  of  data  for  the 
components  noted  above. 

Data  Modifications 

NCES  data  bases  should  be  expanded  to  provide  a  broader  and  more 
detailed  source  of  information  about  K-12  education.    Specific  reconmendations 
for  exransion  appear  in  Tables  1  and  2.    Table  1  identifies  data  elements 
that  need  to  be  added  to  existing  data  collection  components.    Table  2 
identifies  data  elements  that  should  be  collected  through  additional 
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surveys.    Additional  surveys  are  needed  to  provide  a  more  comprehensive 

assessment  of  the  setting,  characteristics,  practices,  personnel, 

conditions,  and  outcomes  of  K-12  education  at  the  local  level.  Suggested 

data  elements  in  the  table  would  be  useful  in  providing  estimates  of: 

0    A  wider  array  of  local  conditions  related  to  school, 
teacher,  and  pupil  performance. 

o    Variation  within  schools,  districts,  regions,  and 
the  nation  in  the  presence  of  conditions  likely  to 
influence  education  quality. 

o    Many  dimensions  of  education  practice  ?t  a  given 
time  and  place. 

A  major  desirable  outcome  of  expanding  the  NCES  program  will  be  an 
Improved  data  base  for  professional,  governmental,  and  public  decisions 
regarding  ways  to  improve  the  quality  of  K-12  education.    Such  data  can 
contribute  to  a  better  understanding  of  the  complexity,  variation,  and 
similarities  of  K-12  education  throughout  the  nation.    The  data  can  be 
used  to  study  problems,  opportunities,  and  decision  options  related  to 
improving  education.    The  data  can  also  be  used-to  study  departures  from 
traditional  approaches  to  funding,  accrediting,  evaluating,  and  changing 
public  schools. 

The  utility  of  NCES  data  bi-^es  can  also  be  increased  if  the 
following  criteria  are  consistently  met: 

o    Conditions  in  education  ar*  accurately  measured  and 
reported. 

o    Data  are  collected  with  instruments  that  meet  high 
technical  standards. 

o    Data  are  collected  under  normal  conditions. 

0    Data  are  made  available  to  users  in  a  time^v  fashion. 
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Importance  of  NCES  Series 

Statistical  information  produced  by  NCES  shapes  thousands  of 
decisions  by  government  and  nongovernment  users  alike.    The  need  for 
these  data  has  escalated  during  the  eighties  a         marchers,  legislators, 
and  the  public  focus  on  issues  of  educational  Improvement. 

The  Importance  of  NCES'  statistical  programs  has  grown  in  conjunction 
with  this  expanding  need.    Consumers  of  education  data  have  come  to  view 
NCES  data  series— all  series—as  accurate,  non-biased  sources  of  informa- 
tion with  which  to  address  an  increasingly  complex  education  enterprise. 
While  each  NCES  data  series  has  a  wide  audience  of  users  and  may  be  con- 
sidered as  essential  to  the  planning  and  design  of  public  education 
policies,  the  Common  Core  of  Data  may  represent  the  most  heavily  used 
series  of  public  school  statistics. 

The  Core  is  the  cornerstone  of  educational  information  in  the  United 
States.    No  other  public  or  private  Institution  collects  and  maintains 
public  education  data  to  the  extent  that  NCES  does  via  the  Core.  Several 
groups — including  the  NEA — conduct  data  collection  activities  which 
parallel  the  Core  In  some  respects,  but  these  efforts  pale  in  comparison 
to  the  NCES  program.    For  this  reason  and  others,  the  support  and  main- 
tenance of  the  Core  component  should  be  a  national  priority. 

The  Core  represents  the  most  basic  data  series  within  the  NCES. 
It  enables  assessments  of  what  was,  vhat  is,  and  what  will  be  in  a 
statistical  sense.    Annual  updates  to  Core  surveys  provide  basic  statis- 
tical Information  on  public  schools,  their  pupils,  personnel,  and  finances. 

) 
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This  Information,  by  school,  LEA,  or  state,  serves  as  an  Invaluable  tool 
for  measuring  change,  signaling  trends,  and  c'esignlng  future  education 
policies.    Data  from  the  Core  are  used  as  benchmarks,  goals  or  objectives, 
and  measures  of  success  and  failure.    Simply  stated,  the  Core  allows  us  to 
"know  things"  about  public  education,  and  thereby  allows  ^s  to  "do  things" 
about  public  education. 

The  Core  stands  ready  to  support  basic  research,  budgeting  decisions, 
and  programmatic  planning.    It  can  uncover  questions  and  issues  requiring 
further  Investigation.    Data  collected  through  the  Core,  then,  are  of 
Immense  value  in  and  of  themselves,  but  they  also  serve  as  means  to  the 
achievement  of  numerous  goals. 

Educational  issues  of  concern  to  government  officials,  educators,  and 
the  public  throughout  the  remainder  of  the  twentieth  century  will  call  for 
education  Information  as  provided  through  the  Core.    Indeed,  selected 
variables  from  the  Core  can  and  have  been  used  to  help  assess  the  outcomes 
of  recent  reform  Initiatives  in  various  states.    This  evaluative  process 
is  vital  to  the  prospects  for  meaningful  reform  of  public  education  offerings. 

Data  Deletion 

The  NEA  recommends  against  any  reductions  or  elimination  of  existing 
NCES  data  series.    We  believe  that  all  the  series  and  items  are  vital  to 
the  interests  of  the  educational  community. 

Relevance,  Quality,  and  Utility 

The  summary  documents  and  data  tapes  provided  by  the  NCES  have 
been  useful  to  the  NEA.    NCES*  access  to  school  and  school  district  data 
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and  their  data  collection  processes  cannot  be  matched  by  any  nongovernmental 
organization,    NEA  believes  that  the  work  of  NCES  Is  vital  to  our  own  efforts 
In  service  to  the  education  community,    NEA  does  have  specific  recommenda- 
tions for  improving  the  data,  the  collection  process,  and  the  dissemination 
of  the  data  in  order  to  increase  the  relevance,  technical  quality,  and 
utility  of  the  data  programs. 

The  relevance  can  be  Improved  by  providing  more  timely  data,  access 
to  more  raw  data,  consistency  between  public  and  private  school  surveys, 
and  consistency  in  surveys  over  years,    Tlie  speed  with  which  the  data  are 
made  available  to  the  public  is  critical.    The  availability  of  the  raw 
data,  on  tape,  permits  NEA  and  others  to  perform  their  own  analyses.  The 
use  of  the  same  questions  for  public  and  private  school  surveys  permits 
more  extensive  matching  and  comparing  of  school  systems  on  a  wide  variety  ^ 
of  attributes.    The  same  issue  of  consistency  applies  to  surveys  repeated 
over  the  years.    The  use  of  the  same  questions  permits  an  analysis  of 
trends. 

The  technical  quality  can  be  improved  by  ensuring  complete  and 
accurate  documentation,  more  complete  editing  of  the  data,  and  Increased 
efforts  to  eliminate  missing  data.    Data  provided  on  tape  should  be 
thoroughly  reviewed  for  errors  in  record  descriptions  and  data  documenta- 
tion.   More  comprehensive  edit  checking  would  reveal  inconsistencies  in 
the  data.    For  example,  the  computation  of  ratios  between  certain  items 
such  as  enrollment  and  teachers  would  highlight  unreasonable  data  con- 
figurations that  do  not  appear  in  individual  items.    The  use  of  random 
audits  for  individual  schools  and  districts  may  reveal  ambiguous  data. 
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or  areas  of  difficult  data  gathering.    For  example,  a  review  of  individual 
districts  may  reveal  that  the  definitions  of  staff  categories  used  by 
districts  do  not  match  those  of  NCES.    Efforts  to  revise  or  to  promote 
use  of  those  codes  could  then  be  undertaken.    The  elimination  of  missing 
data  could  provide  more  accurate  sumiaary  data. 

The  usefulness  of  the  data  can  be  Improved  by  providing  more  docu- 
mentation on  the  availability  of  NCES  data  and  more  contact  with  NCES 
personnel  for  future  survey  planning.    NEA  needs  to  know  what  data  are 
available  from  NCES,  in  what  forms  the  data  are  available,  and  when  the 
data  are  released.    Increased  contact  between  NCES  and  the  user  community 
will  enhance  the  use  of  present  data  and  the  planning  of  future  surveys. 
The  process  for  future  survey  planning  that  is  now  being  Implemented  is 
an  excellent  step  and  should  be  maintained. 
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Table  1.    Summary  of  NEA  Suggestions  for  Additions  and  Changes  for 
NC£S  Data,  By  Census  and  Survey 


NCES  Component 


NEA  Suggestions 


Common  Core  of  Data 


1.  Public  School  Universe 


2.  Local  Education  Agency 
Universe 

3.  Local  Education  Agency 
Nonfiscal  Report 


4.  Public  School  District 
Finance  Report 


0    Add  spring  membership. 

0    Add  full-time-equivalent  classroom  teacher 
by  sex  and  elementary/secondary  level. 

o    No  additions  or  changes. 

0    Add  fall  membership  by  grade. 

0    Add  number  of  full-time-equivalent  LEA 
employees  in  all  employee  categories* 

0    Add  nimiber  of  full-time-equivalent  teachers 
by  individual  grade. 

0    Add  presence  or  absence  of  collective 
bargaining  agreements  for  teacher , 
administrator,  and  educational  support 
personnel  groups. 

0    Provide  revenue  by  source  consistent  with 
NCES  handbook  on  financial  accounting. 

o    Provide  expenditure  by  function  consistent 
with  NCES  handbook  on  financial  accounting. 


0    Provide  other  uses  of  funds  by  category 
consistent  with  NCES  handbook  on  financial 
accounting. 

0    Provide  special  exhibits  by  category 

consistent  with  NCES  handbook  on  financial 
accounting. 


5.  State  Aggregate  Nonfiscal 
Report 


0    Add  fall  membership  by  individual  grade. 
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Tab''     1  continued 


r 


NCES  Component 


Nonflscal  continued 


6.  State  Aggregate  Fiscal 
Report 


NEA  Suggestions 


0    Add  full-time-equivalent  employees 

by  mcjor  assignment  category,  by  state- 

0    Add  number  of  high  school  graduates. 


o    Make  revenue ^  expendicure,  rther  uses, 
and  special  exhibics  detail  consistent 
with  revisions  ouggested  for  district 
finance  data* 

o    Add  average  dally  attendance. 

o    Add  state  lav  defining  average  daily 
attendance* 

o    Add  state  aid  formulae. 


Sample  Surveys 

1.  Private  School  Survey 


o    Add  fall  membership  by  individual  grade. 

o    Add  total  membership. 

o    Add  design  capacity  of  school. 

o    Add  ethnicity  enrollment  as  percent  of 
total  enrollment. 

o    Add  grade  span. 

o    Add  teacher  college  credits  by  subject 
matter  fielu. 

o    Add  Information  on  additional  training 
for  teachers. 

o    Add  personal  characteristics  of  teachers. 

o    Add  membership  by  major  subject. 

o    Add  average  SAT/ACT  scores  and  percent 
tested  by  school. 

o    Add  teacher  incenti\  plans. 

o    Add  teaching  assignment  and  classroom 
enrollment  for  teachers. 
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Table  i  continued 


NCES  Component 


NEA  Suggestions 


Private  School  continued  o    Add  teacher  hours  per  week  by  activity. 

o    Add  number  of  volunteers  by  activity 
category. 


2.  Public  School  Survey 


3.  Recent  College  Graduates 
Survey 


4.  Survey  of  Teacher  Demand 
and  Shortage 


o    Add  fall  membership  by  individual  grade. 

o    Add  highest  degree  earned  by  teacher. 

o    Add  number  or  years  experience  by  teacher. 

o    Add  admission  requirements,  disciplinary 
policies,  length  of  day  and  school  year, 
and  other  characteristics  consistent  with 
private  school  survey. 

o    Develop  better  descriptors  for  this  data 
set. 

o    Add  SAT/ACT  scores. 

o    Add  academic  program/ pr'^parat ion  detail, 
o    Add  more  demographic  deLail. 

o    Provide  rationale  for  number  of  private 
schools  in  curvey  sample. 

o    add  number  of  teachers  leaving  and  why. 

o    Add  number  of  full-time-equivalent  teachers 
by  grade. 

o    Add  class  size  by  type  of  class. 

o    Add  number  of  budgeted  positions. 

o    Add  number  of  needed  positions. 

o    Add  descriptions  of  recruitment  and 
employment  practices. 

o    Provide  rationale  and  greater  detail  for 
teacher  incentive  ^lans. 
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Table  1  continued 


NCES  Component 


NEA  Suggestions 


5.  High  School  And 
Beyond 


6.  Library /Med la  Center 
Survey 


0    Add  descriptions  of  teacher  and  student 
recruitment  and  placement  policies. 

0    Add  more  male  guardian  questions  on  the 
parent  questionnaire — whether  he  was 
present  during  pre-school  years,  worked, 
etc. 

o    Add  community  descriptive  elements  such 
as  racial/ethnic  mix,  community  size. 


0    Add  number  of  books,  materials  loaned. 

o    Add  number  of  computers,  programs  available. 


Other  Agency  Data 

1.  Preprimary  Enrollments 
of  Children  3-5 
Years  Old 


o    If  this  survey  is  repeated,  add  length  of 
program  day,  program  year. 

0    Add  enrollment  and  placement  requirements 
for  students. 

o    Add  health  care  services  descriptions. 

o    Add  state  law  governing  provision  of  pre- 
prd'nary  education. 

o    Add  state  law  govwTning  attendance. 

o    Add  more  program  description. 
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Table  2.    Reconmended  Data  Elements  By  Major  Category  For  New  Or  Expanded 
NCES  Sample  Survey  Component 


A.  Students 

1.  Fall  membership  by  grade 

2.  Enrollment  by  subject  matter 

3.  Students  qualified  for  special  programs 

4.  Students  enrolled  in  special  programs 

5.  Average  SAI'/ACT  scores  and  percent  of  students  tested 
6«  Ethnicity  status  and  percent  of  total  enrollment 

7.  Student  transfers 

8.  Student  dropouts 

9.  Student  attendance 

10.  E'cperience  with  violence 

11.  SES  distribution 

B.  Teachers 

1.  FTE  by  school  level 

2«  FTE  by  category  (regular,  special  education,  etc.) 

3.  Assignment  type  (department  head,  chair) 

4.  Tenure  status 

5.  Job  differentiation  status  (Master  teacher,  mentor  teacher,  etc*) 

6.  Activities  in  day 

7.  Highest  earned  degree 

8.  Tears  of  experience 

9.  Education  specialty  in  college 

10.  Salary  average  per  school 

11.  Salary  intervals  per  school 

12.  Additional  training 

13.  Credits  by  subject,  continuing  education 

14.  Marital  status 

15.  Sex 

16.  Age  intervals 

17.  Race 

C.  Administrators 

1.  Hi^liest  degree  earned 

2.  Years  experience 

3«  Education  specialty  in  college 

4.  Salary  average  per  school 

5.  Marital  status 

6.  Sex 

7.  Age  intervals 

8.  Ethnicity 

9.  Administrator  salary  schedule 

10.  Administrator  salary  by  intervals 
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Table  2  continued 


D.  Educational  Support  Personnel 

1.  Standard  definitions  and  classifications 

2.  FTE  by  job  category 

3.  Compensation  plan*  fringe  benefits 
4    Job  qualifications  by  category 

5.  Staff  development  practices 

6.  Evaluation  practices 

7.  Supervisory  practices 
8«  Demographic  data 

E.  Finance 

1.  Revenue  by  source  (include  private  and  federal  grants) 

2.  Expenditures  by  major  assignment  category:  compensation 
and  fringe  benefits 

3.  Expenditures  by  major  classification 

F.  Programs  and  Practices 

1.  Length  of  school  day 

2.  Length  of  school  year 

3.  Programs  offered 

4.  Class  size  by  class  type 

5.  Pupil  load 

6.  Admission  policies  by  type  of  school 

7.  Teacher  activities  by  percent  of  time 

8.  Teacher  incentive  plans 

9.  Teacher  education  progrsui.s 

10.  Teacher  support  programs 

11.  Teacher  evaluation  process 

12.  Discipline  policies 

13.  Job  differentiation  plans 

14.  Standardized  testing  programs 

15.  Grading  policies 

16.  Span  of  teacher  authority 

G.  Classroom 

1.  Classroom  size 

2.  Classroom  opace 

3*  Books  and  materials 

4.  Audio-visual  equipment,  high  tech  equipment 

5.  Available  supplies 

H.  School  Administration 

1.  Source  of  authority  (public,  private:  religious,  norreligious) 

2.  Structure  (single  school,  state,  private  network) 

3.  Location  of  school  (city,  suburb,  rural) 
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NGA  CQNMENTS  ON  NCES 
REDESIGN  OF  TOE  ELEMENTARY/SECONDARY 
EDUCATION  DATA  PROGRAM 


Introduction 


A  majority  of  the  governors  indicated  in  their  1984  and  1985  state  of  the 
state  messages  that  education  continues  to  be  a  top  priority.  The  general  theme 
of  the  1984  and  1985  state  initiatives  has  been  to  improve  the  quality  of  the 
education  system.  The  governor  as  the  state's  chief  executive  officer  guides 
education  policy  in  primarily  three  vays.  First,  the  governor  performs  a 
leadership  role  in  setting  the  agenda  for  and  promoting  activities  on 
educational  improvement s/refoim.  Second,  the  governor  is  responsible  for 
deve] oping  state  budget  requests  for  education  expenditures.  In  many  states  the 
education  budget  accounts  for  as  much  as  30  percent  of  the  total  state  budget, 
and  third,  many  governors  are  responsible  for  appointing  state  education  board 
members. 

As  leaders  in  setting  the  state  education  agenda,  governors  in  1985 
planned  to  focus  primarily  on  initiatives  to  improve  the  teaching  profession, 
address  student  quality  through  improvements  in  math  and  science  instruction, 
and  examine  and  increase  the  financing  of  education.  This  represents  a  shift  to 
more  specific  strategies  from  the  broader  initiatives  of  the  past  few  years  to 
link  educational  reform  and  improvements  with  other  state  policies  directed  at 
promoting  state  revitalization  and  economic  growth.  Table  1  indicates  that  in 
1985  the  largest  number  of  states  expressed  an  interest  in  the  issues  concerning 
incentives  in  the  teaching  profession.  Twenty  three  states  emphasized  teacher 
career  ladders  and  21  states  emphasized  teacher  salaries.  Of  the  remaining  top 
ten  issues,  4  are  related  to  school  administration,  3  of  these  to  financing 
mechanisms  and  1  related  to  school  administration  reform.  Another  four  issues 
are  related  to  student  quality  including  student  competency  and  child  abuse.  In 
comparison,  in  1984  the  governors  in  29  states  emphasized  their  interest  in  the 
broader  aspects  of  building  stronger  partnerships  between  education  and 
business/industry.  Private  r  'tor  lirdcages  were  seen  as  a  means  to  accomplish 
the  goals  of  preparing  a  better-educated  future  work  force  and  thereby 
contributing  to  the  state's  future  economic  growth  potential. 
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Table  1 


Top  Ten  Education  Issues  Cited  in  the  1985 
State  of  the  State  Messages 

Number  of  States 


Issue  Area  Citing 

Teacher  Career  Ladder  and  Development  23 

Teacher  Salaries  21 

Math/Science  Instruction  20 

Finance  Formula  20 

Economic  Development,  Voc.  Ed.,  and  Tech.  19 

School  Administration  Quality  and  Reform  18 

Funding  Increase  18 

Local  School  Aid  18 

Student  Testing  and  Competency  17 

Child  Abuse  17 


Source:     Governors'  State  of  the  State  Messages,  1985  (Forty-seven 
state  messages  reviewed.) 


During  the  1980' s,  more  than  30  states  have  enacted  major  financial 
reforms  of  elementary /secondary  education.  In  1984,  25  governors  planned  to 
enhance  education  efforts  by  providing  more  fiscal  resources  and  9  governors 
proposed  tax  increases  to  provide  adequate  resources  for  the  improvement  of 
their  states'  educational  system.  The  majority  of  the  funding  increases 
proposed  (20  states)  was  planned  for  use  in  raising  teachers'  salaries  while  9 
states  proposed  funding  for  improvements  of  school  facilities  and  equipment. 
Ten  states  proposed  increasing  state  aid  to  local  schools  systems.  In  1985,  20 
governors  were  interested  in  finance  formula  issues,  18  governors  plan  to 
enhance  education  efforts  by  providing  more  fiscal  resources  and  18  governors 
emphasized  local  school  aid.  This  represents  a  significant  shift  from  the 
1970' s  when  more  than  28  states  enacted  major  financial  reforms  for  elementary 
and  secondary  education  to  equalize  fiscal  resources  among  school  districts  in 
order  to  relieve  property  taxes  and  legal  challenges. 


State  Policy-Makers  Data  Needs 


In  order  to  perform  education  policy  setting  functions,  states  need  to 
plan,  develop,  implement  and  evaluate  education  initiatives.  For  these  purposes 
a  combination  of  state  and  national  data  are  useful.  State  produced  education 
data  which  are  designed  to  meet  specific  state  needs  provide  the  core  for  state 
education  policy-making.  All  state  education  policymakers  rely  heavily  on 
information  from  the  State  Education  Department  but  also  on  local  school 
districts  and  on  education  associations.  However,  national  trend  data  and 
consistent  and  accurate  data  from  all  .states  for  macro  comparison  purposes  is  of 
key  interest  as  well. 

The  top  ten  priority  issues  as  identified  in  the  governors'  state  of  the 
V  state  messages  can  be  used  to  provide  a  framework  for  a  discussion  of  data 
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needs.  The  list  o£  the  top  ten  education  topics  is  provided  to  give  a  picture 
o£  the  current  education  topics  of  interest  to  governors.  We  are  not 
suggesting,  however,  that  in  trying  tc  determine  the  needs  of  the  data  system 
for  elementary/secondary  education  for  the  next  10  years,  that  currently  popular 
issues  sucn  as  those  identified  in  Table  1  be  used  exclusively  as  a  barometer  of 
long-term  data  needs.  This  list,  however,  does  reflect  back  to  some  broader 
core  issues  that  fluctuate  little  over  tte  long  run. 

The  education  citations  in  the  state  messages  can  be  organized  into  three 
general  issue  areas  vdiich  include  improving  student,  teacher  and  school 
administrative  quality.  Table  2  illustrates  this  organization  and  ranks  the 
topics  in  each  of  the  three  areas.  As  can  be  seen  from  this  table,  the  primary 
topics  of  interest  to  improve  student  quality  concern  basic  education  focusing 
on  technology  and  technical  skills.  Other  areas  include  competency  measurement, 
child  care  and  well  being,  student  groups  at  the  extremes  (dropouts  and  gifted) 
and  special-need  students;  and  community  behavior  that  affects  student  outcome. 
The  issue  of  graduation  requirements  ranks  last.  The  key  issue  in  improving 
school  administration  is  school  finance.  Other  issues  include  general 
management  initiatives.  Of  somewhat  lesser  interest  is  the  issue  of  teacher 
shortage. 

The  list  of  issues  in  Table  2  can  be  examined  in  terms  of  more  specific 
data  items  to  determine  which  are  of  interest  to  state  education  policymakers. 
The  Education  Policy  Consortium  developed  a  preliminary  list  of  potential  data 
items  of  interest  to  consortium  member  associations  and  their  constituencies. 
These  data  items  listed  in  Table  3  are  organized  for  this  paper  into  four 
categories  including  student  data,  teacher  data,  school  data  and  finance  data. 
The  data  items  related  to  the  governors'  top  ten  priority  issues  are  indicated 
with  an  asterisk  as  are  the  items  generally  available  through  NCES. 

In  the  first  area  in  Table  3,  student  data,  the  governors  are  not  timid  to 
talk  about  measurement  of  educational  outcomes  across  states.  As  more  states 
move  toward  preparing  a  better  educated  workforce  to  encourage  economic 
development  the  issue  of  identifying  student  outcomes  emerges  as  more  than 
assessing  student  achievement.  More  data  than  test  scores,  such  as  the  SAT,  are 
needed  to  determine  post-school  experiences.  The  education  process  should  be 
traced  from  start  to  outcome  to  determine  vdiat  happens  to  the  in-school 
population  tpon  leaving  an  education  program  (by  graduating  or  dropping  out), 
what  are  their  post-school  labor  market  experiences  in  terms  of  employment, 
unemployment  and  earnings,  and  whether  they  re-enter  school  at  some  future 
time.  In  the  future,  student  outcome  measures  may  be  one  set  of  evidence  used 
in  evaluating  education  reform  policies  currently  being  initiated. 

Longitudinal  studies  such  as  the  High  School  and  Beyond  Survey  are  one  way 
of  determining  outcome  measures.  This  is  one  of  the  few  surveys  that  capture 
data  from  students  on  a  longitudinal  basis.  It  seems,  because  of  its  somewhat 
unique  nature  that  this  questionnaire  siiould  be  a  priority  to  be  maintained, 
improved  in  terms  of  data  quality  and  potentially  be  expanded  to  gather  more 
data,  in  terms  of  content  and  sample  size  to  make  the  data  more  state  specific. 

In  the  second  area,  outlined  in  Table  3,  teacher  data,  the  governors  are 
currently  interested  in  examining  the  teaching  profession  as  a  primary  factor  in 
improving  the  education  system.  Incentives  to  keep  and  attract  quality  teachers, 
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Table  2 

Summar/  of  Education  Initiatives 
Cited  in  the  Governors'  1985  State  of  the  State  Messages 


A.    Topics  Cited  to  Improve  the  Quality  of  K-12  Students 


Number  of 

Rank 

Topic 

States 

1 

Math  §  Science  Instruction 

20 

2 

Economic  Development,  Voc.  Ed.  5  Tech. 

19 

3.5 

Testing  and  Competency 

17 

3.5 

Child  Abuse 

17 

5 

Child  Care  §  Early  Oildhood 

15 

6 

Dropouts  §  Disciplinj 

13 

7 

Gifted 

12 

8 

Computer  Literacy 

11 

9 

Community  §  Parent  Involvement 

10 

10 

Special  Ed.  §  Handicapped 

8 

11 

Graduation  Requirements 

4 

B.    Topics  Cited  to  Improve  the  Quality  of  K-12  Teachers 

Number  of 

Rank  Topic  States 

1  Career  Ladder  §  Development  23 

2  Salaries  21 

3  Certification  §  Evaluation  11 


C.    Topics  Cited  to  Improve  Quality  of  K-12  School  Administration 


Number  of 

Rank 

Topic 

States 

1 

Finance  Formula 

20 

3 

Administrative  Quality  §  Reform 

18 

3 

Funding  Increase 

18 

3 

Local  School  Aid 

18 

S 

Management /Class  Size 

13 

6 

Facility/Equipment/Text  Books 

11 

7 

Teacher  Shortage 

4 

Source:  Governors*  State  of  the  State  Messages,  1985.  (Forty-seven  -tate  messages 
were  reviewed.) 
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Table  3 

Preliminary  List  of  Education  Policy  Consortium 
Identified  Data  Items  Related  to  the  Top  Ten  Governors'  Priorities 


Governors'  NCES 
Top  Ten  Data 
Topic  Data  Item  Description  Priorities  Available 

STUDENT  Achievement  *  * 

DATA  test  scores 

school  grades 

promotion  record 

Attainment  * 
drop  out  rates 

post  drop  out  experience 
graduation  rates  * 

post  graduation  experience 

In-School  Behavior 

attendance/truancy 
vandalism 

suspens  i  on/expul s  i  on 

course  enrollments  *  * 

attitudes 

Community  Behavior 

voter  registration  and 
participation 

Individual  Characteristics  *  * 

demographic  (age/race/sex) 
SES  background 
grade  level 

type  of  school  attending 
migrant/refugee 
primary  language 
handicap 

abused  as  a  child  * 

TEACHER  Training/Certification 
DATA  formal  education 

participation  in: 
in-service  training 
pre-service  training 
loan/scholarship  availability 
certification  subjects 

Evaluation  of  performance 
classroom  evaluation 
competency  test  scores 
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Table  3  (Continued) 


Tofic 


Data  Item  Description 

Compensation 

pay  for  perfcnnance 

incentives 

salaries/benefits 


Governors ' 
Top  Ten 
Priorities 


NCES 
Data 
Available 


Employment  Status 

retention  rates 

reasons  for  leaving  profession 
working  conditions 
years  of  service 
course  assignments 

Personal  Characteristics 

demographic  (age/race/sex) 
attitudes 

academic  talents  by  employed/ 
leaver 


SCHOOL 
CHARACTER- 

(  ISTICS  DATA  Curriculum  and  Assessment 

Improvement 
Instructional  materials 
Training 

Alignment  of  curriculum 
within  grade,  across  grade, 
with  assessment 
LEA  and  state  testing 
Education  indicators  other  than 
tests 

School  Improvement 
strategies 
training 

planning  process 
curriculum  improvement 

State  Role 

monitoring/accountabi li ty 
technical  assistance 
relationship  to  local  districts 

Technology 

Community  Involvement/Satisfaction  with 
Schools 

( 
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Table  3  (Continued) 


Governors'  NCES 

Top  Ten  Data 

Topic                         Data  Item  Description            Priorities  Available 

FIMWCE             State  and  Local  Revenues                       *  * 


DATA  tax  base  level  and  compo, 

tax  rate  level  and  compo, 
total  revenues 
sources  of  revenues 
relief  provisions 
revenue  limitation 
provisions  for  non-public 

Expenditures  (local)  *  * 

total  expenditures 
total  elementary/secondary 

expenditures 
expenditures  by  category 
cost  of  special  programs 
student  aid  categorical  vs. 

formula  aid  for  special 

student  population 

expenditure  limits 

Federal  Aid  *  * 

total  amount  by  state 
allocation  formulas  used 

(federal  and  state) 
state/local  split 
administrative  services  split 
source  of  match 
$  amount  of  audit  except 
$  amount  of  carryover 

Source:  This  preliminary  data   item  list  was  derived  from  an  Education 

Policy  Consortium  meeting,  February,  1985. 
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(  such  as  compensation  and  career  ladders  are  of  key  interest.    Of  particular 

concern  is  the  notion  of  higher  salaries  generating  more  qualified,  teachers, 
which  if  validated,  would  encourage  states  to  change  salary  structures,  increase 
the  minimum  and/or  average  teacher  salaries  and  establish  *nerit  or  incentive  pay 
programs.  Of  lesser  interest  to  gov^^mors  is  the  number  of  teachers  employed 
and  teacher  shortages.  Tf  the  profession  has  attractive  incentives,  the  issue 
of  teacher  shortage  may  be  of  negligable  importance. 

The  Public  and  Private  School  Surveys  which  both  collect  information  on 
these  topics  should  be  among  NCES  priorities.  The  samples  should  be  examined  to 
detemiine  the  feasibility  of  expansion  to  collect  data  more  state  specific. 
This  should  be  considered  in  conjunction  with  the  further  examination  of 
appropriate  state  administrative  records  and  a  deemphasis  on  the  Teacher  Demand 
and  Surplus  Survey. 

In  the  fourth  area  of  Table  3,  information  on  school  finance  has  been  an 
issue  of  interest  for  a  number  of  years  and  will  no  doubt  continue  to  be  of 
interest  as  efforts  to  improve  the  school  system  are  continued  into  the  next 
decade.  While  the  issue  is  not  a  new  one,  a  shifting  focus  overtime  to 
different  aspects  of  school  finance  is  evident.  The  equity  issue  of  the  1970' s 
in  funding  local  school  districts  has  shifted  to  interest  in  funding  formulas, 
budget  increases  and  increasing  teacher  salaries.  Of  interest  in  the  future 
will  be  financing  issues  of  public  versus  private  schools.  Basic  finance 
information  concerning  both  sectors  should  continue  to  be  considered  a  core  data 
element  in  any  elementary /secondary  education  data  system.  Particularly  in  the 
Private  School  Survey,  attention  should  be  given  to  the  finance  questions.  To 
(  enhance    their  data   base,   NCES   should   also  examine   the   finance  data  base 

maintained  by  ECS. 

Data  Duplication/Overlap 

If  the  NCES  data  collections,  as  presented  in  Attachme-'t  B  of  the  initial 
correspondence  concerning  the  redesign,  are  examined  by  subject  area  rather  than 
by  data  collection  program  some  duplication  of  effort  becomes  evident.  For 
example,  if  the  topic  of  information  on  teachers  is  examined  then  it  appears 
from  a  cursory  review  that  several  surveys  collect  information  on  teachers  in 
addition  to  the  data  available  from  administrative  records.  We  recommend  a 
thorough  review  o£  the  Survey  of  Teacher  Demand  and  Shortage,  Recent  College 
Graduates  Survey  and  the  Public  School  Survey  to  examine  duplication.  All  three 
ask  questions  of  teachers  concerning  subject  matter  assignments.  The  Public 
School  Survey  and  the  Survey  of  Teacher  Demand  and  Shortage  both  ask  questions 
concerning  teacher  incentive  plans.  The  Recent  College  Graduate  Survey  as  well 
as  the  Public  and  Private  School  surveys  obtain  teacher  salary  and  compensation 
data. 

In  addition,  there  is  duplication  between  NCES  and  other  federal  agency 
collections.  For  example,  the  Bureau  of  Labor  Statistics,  as  part  of  the 
Occupational  Employment  Statistics  (OES)  program  collects  data  every  three  years 
on  current  teacher  employment.  Another  form  of  duplication  is  when  information 
is  collected  in  a  survey  but  is  already  available  in  administrative  records. 
Information  on  the  number  of  new  hires  and  the  number  of  those  teachers 
returning  to  their  previous  position  from  the  survey  of  Teacher  Demand  and 
Shortage  could  potentially  be  obtained  through  the  Employer's  Quarterly  Wage  and 
Tax  Report  of  State  Employment  Security  Agencies  (SESAj. 
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We  would  recommend  that  because  of  the  apparent  duplication  the  Survey  of 
Teacher  Demand  and  Surplus  be  given  a  very  low  priority  and  reviewed  to 
determine  if  it  should  be  conducted  at  all.  It  seems  that  the  data  could  be 
obtained  primarily  from  the  BLS  OES  program,  state  administrative  records  and  if 
needed  through  the  Public  and  Private  School  Survey.  As  well,  the  recent 
College  Graduates  Survey  should  be  examined  to  determine  what  information  is 
received  that  can't  be  derived  from  College AJniversity  and  SESA  administrative 
records  and/or  the  Public  and  Private  School  Surveys. 

Although  the  area  of  teacher  data  seems  to  have  the  largest  number  of 
separate  collections  and  therefore  the  greatest  potential  for  duplication,  other 
areas  as  well  may  also  have  inefficiencies.  Beyond  this  one  example  cited  above 
which  needs  further  examination,  vo  suggest  that  NCES  do  a  comprehensive  review 
of  their  data  collections  across  subject  areas  to  explore  further  efficiencies 
that  could  be  realized  through  undiq)licated  data  collection  and  more  extensive 
use  of  administrative  records.  A  single  collection  instrument  that  obtains 
relevant  data  for  nailtiple  purposes  and  users  appears  to  be  a  far  more  efficient 
use  of  resources  than  multiple  shorter  surveys  resulting  in  several  sets  of 
incompatable  data. 

Unmet  Data  Needs 

A  data  system  to  remain  relevant  to  users  should  be  flexible  in  meeting 
data  needs  created  by  the  changing  n?.tnre  of  our  society.  Although  several 
unmet  data  needs  can  be  identified,  no  priorities  have  been  assigned  to  these 
needs  by  state  policy  officals.  For  example,  the  High  School  and  Beyond  Survey 
traces  the  post-high  school  experience  of  graduates  but  not  of  those  youth  who 
are  not  graduating  or  who  have  dropped  out.  This  will  become  an  increasingly 
important  topic  to  detemine  the  experiences  of  the  at-risk  population  and  the 
impacts  of  the  policy  initiatives  of  the  early  1980s.  -  Again,  administrative 
records  may  be  a  to<>l  useful  in  gathering  some  of  this  data  or  it  may  be 
necessary  to  explore  collection  of  these  data  through  the  High  School  and  Beyond 
Survey. 

States  need  to  identify  education  outcomes  related  to  their  own  labor 
markets  to  fully  use  the  data  in  their  own  policy  development  process,  because 
of  different  industry  structures,  different  rates  of  growth/decline  and 
different  labor  market  barriers  and  characteristics.  For  this  reason,  states  do 
not  find  useful  national  longitudinal  education  data  that  only  report  national 
estimates,  estimates  for  the  9  census  regions  and  the  7  largest  states. 
Although  6  or  7  states  paid  to  have  data  collected  for  a  state  specific  sample, 
generally  there  is  no  state  level  detail  available. 

We  acknowledge  funding  limitations  and  because  of  this  are  supportive  ot 
NCES  efforts  that  would  be  more  creative  in  developing  arrangements  to  have 
states  expand  their  samples.  Also  NCES  should  consider  expanding  the  national 
sample  to  provide  more  state  specific  data. 


Another  gap  is  information  on  career  ladders  within  the  teaching 
profession.  Although  there  is  a  general  lack  of  this  type  of  information  for 
most  occupations,  with  the  emphasis  being  placed  on  incentives  for  teachers, 
this  information  is  valuable.    Methods  to  obtain  this  data  should  be  considered 
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by  NCES  working  cooperatively  with  the  National  Occupational  Information 
Coordinating  Conunittee. 

Issues  That  Crosscut  Specific  Data  Programs 

The  NCBS  efforts  to  assure  quality  data  is  produced  as  recommended  in  the 
NCES  '"Research  in  Statistics"  report  are  critically  important.  Governors  and 
state  policy  representatives  are  seriously  concerned  about  the  accuracy  of 
reported  data.  It  is  generally  acknowledged  that  there  are  few  validity  studies 
made  or  audits  done  on  NCES  data  collections.  We  therefore  strongly  support 
work  to  develop  procedures  and  strategies  for  continually  assessing  the  validity 
of  all  NCES  data  programs  and  encourage  NCES  to  make  this  a  top  priority.  There 
are  other  efforts  that  would  also  improve  the  quality  of  data;  such  as 
developing  minimum  definitions  that  would  make  data  consistent  across  states. 

Standardization  of  Data  Needed 

NCES  data  are  most  useful  to  state  policy  makers  when  comparisons  can  be 
made  between  states  and  between  a  state  and  the  national  trend  or  average.  For 
exajiiple,  the  indicators  of  education  status  and  trends  are  an  excellent  vehicle 
from  which  comparions  caii  be  made  if  the  defintions  used  across  states  are 
consistent.  Some  states  even  indicated  to  us  that  it  would  be  prefer rable  to 
have  a  less  extensive  data  collection  effort  that  contained  more  rigidly  defined 
data  elements  that  were  released  more  quickly. 

States  are  very  interested  in  assessing  the  amount  and  method  of  teacher 
compensation.  In  a  survey  of  Governors'  education  policy  staff  conducted  in 
November  1984  by  the  State  Education  Policy  Consortium  43  percent  of  the  states 
responding  in  the  area  of  teacher  quality  indicated  that  the  single  issue  viiich 
would  be  the  roost  important  over  the  next  year  is  teacher  compensation  and  is 
likely  to  remain  so  for  the  next  decade. 

In  this  case,  state  specific  information  on  the  state  education  budget, 
current  compensation  level  and  structure,  the  state  history  of  salary  increases 
by  local  education  agencies,  comparable  personnel  costs  within  the  state,  the 
elements  included  in  the  compensation  package,  ar-d  teacher  characteristics  may 
be  used.  National  information  on  the  current  national  median  teacher  salary, 
whether  it  is  rising/falling  and  by  how  much,  the  variance  of  each  state  from 
the  median  and  where  each  state  ranks  compared  to  others  gives  the  state  a 
relative  measure  of  their  teacher  salary  program  against  a  national  indicator 
and  neighboring  states.  Salary  information  should  be  collected  in  a  consistent 
manner. 

Comparative  measures  that  are  not  based  on  standardized  definitions  to 
guide  data  collection  and  that  do  not  include  .  description  of  what's  reported 
and  what's  not  reported  in  the  data  may  lead  industry  and  education  policy 
analysts  to  erroneous  conclusions.  For  example,  consider  the  detailed 
comparisons  of  data  across  states  for  the  retirement  system.  In  some  states, 
local  government  pays  the  employer  contribution  and  in  others  the  state 
government  pays  the  employer  contribution.  A  state  could  have  relatively  higher 
or  lower  figures  based  on  who  pays  for  the  retirement  system  and  how  the  data 
are  collected.  Another  example  is  enrollment  data  vtfiich,  depending  on  the 
state,  could  represent  average  daily  enrollment  or  a  head  count. 
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Numerous  other  examples  exist  of  data  collections  vAiere  no  standard 
definitions  are  used  and  data  are  not  compatible  across  federal  data 
collectors.  An  example  is  the  long  tenn  debate  on  how  to  define  a  teacher.  The 
BLS/Census  and  NCES  definitions  both  differ.  While  we  do  acknowledge  that  there 
are  different  uses  for  different  types  of  data,  because  of  the  need  to  integrate 
and  use  a  variety  or  data  sources  in  ansv^^-ing  policy  questions  discrepencies 
such  as  t-his  make  it  extremely  difficult  to  accurately  interpret  the  data  being 
examined.  Instead  of  using  different  definitions  in  various  data  collection 
programs  we  believe  that  it  is  the  responsibility  of  the  federal  government  to 
use  common  definitions  for  data  collect ion. 

To  overcome  the  definition  inconsistencies  such  as  these  that  render  the 
data  meaningless  for  the  key  purpose  to  which  they  are  used  at  the  state  level 
will  require  a  sustained  long-term  effort  to  detennine  vAat  are  the  core 
elements  and  how  they  should  be  collected.  While  education  systems  do  vary 
widely  across  states;  it  appears  that  states  would  welcome  common  reporting  on 
certain  national  data  elements  that  would  allow  valid  comparisons  to  be  made. 

Fifteen  years  ago  BLS  had  similar  problems,  with  the  definition  of 
unemployment.  NCES  may  wish  to  look  at  the  BLS  federal/state  cooperative 
programs 

as  an  example  of  how  national  definitions  are  used  particularly  with  state 
administrative  records.  The  BLS  defines  those  data  elements  which  are  necessary 
for  the  national  income  accounts  data.  The  BLS  then  contracts  with  the  state  to 
collect  data  using  these  standard  definitions;  using  the  dollars  as  a  leverage 
tool. 

The  BLS  as  the  major  statistical  agency  responsible  for  labor  force 
statistics  has  defined  the  population  (16  years  and  older)  into  mutually 
exclusive  categories  as  shown  in  Figure  1.  NCES  as  the  major  statistical  agency 
responsible  for  education  statistics,  should  consider  defining  the  population 
(0-16  years  old)  in  a  similar  fashion  of  mutually  exclusive  categories.  This 
would  help  in  the  development  of  definitions. 

Standardizing  data  is  not  done  without  problems.  BLS  has  been  taken  to 
court  over  the  definitions  but  has  won  all  the  cases.  Definitional  problems 
should  be  carefully  examined  through  more  extensive  collaborative  efforts 
between  the  federal  and  state  levels.  A  useful  mechanism  may  be  an  interagency 
approach  lAich  brings  together  users  and  producers  such  as  that  of  the  National 
Occiq)ational  Information  Coordinating  Committee. 

Statistical  Agency  Coordination 

Under  the  authority  of  the  Federal  Paperwork  Reduction  Act  we  would 
recommend  you  pay  particular  attention  to  coordinating  educacion  financial  data 
collected  through  tha  various  programs  with  the  Census  Bureau  vAiich  collects 
state  and  local  fiscal  data  through  the  Census  of  Governments.  The  Census 
Bureau  could  potentially  collect  the  data  for  NCES  under  an  interagency 
agreement  or  contractual  arrangement  collection  similar  to  the  CPS  October 
education  supplement  collection. 

Other  areas  where  interagency  coordination  would  be  appropriate  are  with 
the  Department  of  Labor's  Employment  and  Training  Administration.  Longitudinal 
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Figure  1 
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survey  data  from  a  variety  of  sources  including  the  JTPA  training  programs  would 
be  more  useful  if  coordinated  among  agencies  and  made  more  compatible.  Under 
the  JTPA,  a  longitudinal  job  training  survey  is  conducted  using  a  national 
sample  of  individuals  representative  of  youth,  all  adults  and  welfare  adults 
conducted  on  an  annual  basis.  Data  are  collected  on  the  individuals  at  12 
months  and  24  months  after  program  completion.  We  would  suggest  here  some 
sharing  of  information  between  NCES  and  the  Employment  and  Training 
Administration.  There  may  be  questions  of  interest  to  NCES  which  could  be  added 
to  the  JfPA  Survey  and  as  well  NCES  could  add  questions  of  interest  to  ETA  to 
their  survey.  The  coordination  of  these  sources  of  data  would  provide  an 
expanded  data  base  for  more  extensive  use  and  would  be  a  more  efficient  use  of 
limited  resources. 

Release  Raw  Data  Quickly 

In  muy  situations  data  are  needed  quickly  for  policy  purposes.  For 
exanple,  if  states  want  to  change  their  salary  level  and/or  structure  in 
relation  to  the  current  national  average  trend,  then  data  that  are  several  years 
old  are  not  useful.  The  early  data  systems  being  recommended  by  the  NCES 
'^Research  in  Statistics"  report  is  one  step  to  address  the  issue  of  timeliness. 
However,  states  will  have  limited  uses  for  these  data  due  to  the  small  national 
sample  sizes.  State  education  policy  makers  would  like  quicker  turn  around  time 
on  the  administrative  data  submitted  to  NCES  directly  by  the  states.  An 
emphasis  on  technological  initiatives  that  improve  data  collection,  editing  and 
processing  procedures  and  data  release  capabilities  will  aid  in  shorter 
tum-aroimd  times. 

It  has  been  suggested  by  several  state  data  users  that  the  administrative 
data  collected  from  the  states  be  made  available  in  raw  fonn  to  provide  earlier 
access  by  state  analysts.  Use  of  NCES  data  may  well  increase  if  the  turnaround 
time  from  the  point  when  states  report  data  to  the  point  when  NCES  disseminates 
the  collective  data  sent  back  to  states  is  shortened. 

It  was  suggested  by  several  states  that  NCES  should  concentrate  less  on 
detailed  analysis  of  state-specific  data  or  inter-state  comparisons  and  more  on 
national  trends  and  a  look  to  future  issues.  State  experts  who  are  familiar 
with  the  particular  qualities  of  the  area  being  analyzed  and  the  differences 
between  states  should  be  primarily  responsible  for  this  analysis. 
Interpretation  of  national  data  should  be  conducted  based  on  a  set  of  standards 
which  maintain  the  integrity  of  the  data. 

Conclusion 

There  is  general  support  for  NCES  data  products  and  publications  in  the 
states  although  this  is  not  the  primary  source  of  data  used  for  state  education 
policy-making.  The  states  as  partners  with  the  federal  government  are  conmiitted 
to  the  reportii^  of  state/local  data  under  reasonable  requirements  to  various 
federal  agencies  such  as  NCES  and  national  oi^ganizations.  In  some  states  this 
reporting  activity  may  require  up  to  3  to  4  person-months  per  year.  In 
exploring  the  return  on  the  state's  investment  in  NCES  data  and  the  usefulness 
of  the  nationally  collected  state  education  data  several  key  issues  stand  out 
from  a  'state  policy  perspective.  By  far,  the  most  important  issues  cross 
cutting  a  majority  of  states  are  that  of; 
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(1)  improving  the  quality  of  data; 

(2)  providing  comparability  of  data  across  states,  across  data  programs, 
and  across  data  collectors; 

(3)  the   increased  use  of   state  administrative   records   such  as  those 
available  through  the  SESA;  and 

(4)  capitalizing  on  the  statistical  expertise  in  other  federal  government 
agencies  and  associations. 
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NATIONAL  SCHOOL  BOARDS  ASSOCIATION 
1 6BO  Duke  Street,  Alexandria,  Virginia  223 1  4 
June  27.  1985  c^os)  B3B-nsba 


Mr.  Emerson  Elliott 
Administrator 

National  Center  for  Education  Statistics 
1200  19th  Street,  NW 
Washington,  DC  20208-1631 

Dear  Mr.  Elliott: 

We  are  pleased  to  comment  upon  the  Elementary/Secondary  Education  Data 
Program  proposed  by  the  National  Center  for  Educational  Statistics 
(NCES).   The  redesign  project  is  a  welcome  effort  on  your  part,  not 
only  because  it  is  commendable  of  NCES  to  consider  the  need  to  update 
its  efforts  but  also  (and  especially)  because  we  appreciate  the 
dedication  and  thoroughness  with  which  NCES  is  seeking  counsel  and 
advice  from  throughout  the  community  of  educational  statistics  users. 
We  hope  that  this  NCES  process  will  serve  as  an  exemplar  to  other 
offices  of  the  Department  of  Education. 

The  most  useful  service  to  local  school  district  policy  makers,  and  to 
the  state  school  boards  associations  that  assist  these  local  policy 
makers,  is  that  federal  education  statistics  capture  significant 
trends  in  a  timely  way.  The  current  effort  is  imperfect,  in  this 
regard;  it  catches  some  but  not  others.   For  example,  the  movements 
toward  magnet  schools  and  toward  desegregation  are  not  readily  traced 
in  NCES's  data,  while  changes  In  the  nature  of  the  teaching  profession 
are  more  readily  found  there. 

The  next  decade  —  because  of  the  "excellence  movement,"  the  changing 
demographics  of  the  U.S.  population,  and  the  emerging  electronic 
technologies  that  many  hope  will  improve  society  at  large  and  schools 
in  particular  —  is  likely  to  be  an  era  of  change  in  public  education. 
Capturing  trends,  in  a  timely  way,  will  require  some  reshaping  of 
NCES's  inquiries. 

In  light  of  this  general  conceptual  background,  we  respectfully  offer 
the  following  comments  and  recommendations:  - 

•      We  anticipate  a  continued  policy  interest  in  improving  the 
effects  of  the  schooling  enterprise.   We  need  to  shift  our 
statistical  focus  more  than  we  have,  to  assist  the  public 
debate  about  school  effectiveness.   Certainly  the  public's 
interest  reflected  in  the  "excellence  movement"  has  been 
framed  in  terms  of  increasing  student  learning      not  only 
academic  learning  measured  by  traditional  tests  but  also 
other  kinds  of  learning:   The  changing  nature  of  employment 
has  prompted  attention  to  thinking  skills,  computer 
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capability,  job-seeking  and  job-holding  skills.  Higher 
education  Institutions  have  expressed  concern  about  levels  of 
^writing  and  study  skills.   Some  of  the  nation's  social  Ills 
have  focused  attention  on  a  gamut  of  values  held  by  students 
and  graduates,  ranging  from  entrepreneurship  to  patriotism 
and  racial  tolerance  to  sexual  responsibility.  The  focus  on 
effects  of  schools  should  reflect  this  broad  range  of 
learning.  . 

The  current  NCES  program,  however,  generally  focuses  Its 
attention  on  what  goes  Into  the  schooling  process.  This 
historic  Imbalance  has  an  unintended  consequence:   the  sheer 
weight  of  data  reported  about  the  number  and  characteristics 
of  teachers,  courses  taught,  attendance,  enrollment 
categories,  family  characteristics,  et  al.,  leaves  the 
Impression  that  education  Is  more  Interested  In  counting  our 
resources  than  counting  our  effects.   Moreover,  the  emphasis 
on  statistics  about  the  schooling  process  assures  that 
process  trends  will  mere  likely  be  captured  than  trends  In 
the  effects  of  education,  so  that  the  public  debate  gets 
frustrated.   We  hope  that  NCES  through  this  redesign  project 
will  find  new  ways  to  aid  the  public  s  Interest  In  the 
^  effects  of  schooling. 

•      New  electronic  technologies,  and  new  systems  for  management 
and  Instruction  that  exploit  these  new  tools,  will  serve  and 
reinforce  this  public  emphasis  on  the  effects  of  schooling. 
In  two  ways: 

-  The  arguments  for  and  against  uses  of  computers  and 
other  technology  will  be  formulated  on  the  basis  that 
new  tools  do  (or  do  not)  Improve  the  product  of  the 
schooling  enterprise;  and 

-  Some  of  these  new  tools  enhance  the  ability  of  school 
management  to  gather  t^m^y  data  about  the  success  of 
the  schooling  enterprise. 

We  need  data  about  the  uses  and  impact  of  technology.  There 
Is  much  talk  and  some  considerable  action  In  the  uses  of  new 
technology  but  little  useful  data.  Only  market  sales  data  Is 
currently  available  routinely.   The  current  ad  hoc  study  by 
the  Research  Triangle  funded  by  NCES  on  Computers  for 
Instruction  In  Higher  Education  deserves  a  parallel  study  for 
element iry  and  secondary  education.    (Some  of  the  questions 
in  tha<  -tudy,  that  focus  on  policies  and  academic 
requir     nts  suggest  some  ways  to  address  some  of  the  Issues 
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about  the  effects  of  schooling  also.)    It  would  be  very 
useful  to  know  not  ^nly  what  devices  schools  are  buying,  but 
also  to  what  uses  these  devices  are  being  put,  how  staff  Is 
being  trained,  how  courses  and  budgets  are  being  altered  et 
al. 

Another  aspect  of  technology's  Impact  will  be  changes  In  the 
roles  of  school  professionals.   Current  federal  statistics 
seem  to  suggest  that  all  teachers  are  alike;  and  that  they 
work  In  classrooms.   We  expect  to  see  further  differentiation 
among  school  staff  roles,  fueled  not  only  by  pressures  for 
career  ladders  and  merit  pay  but  also  by  the  Introduction  of 
technologies.   Already,  for  example,  the  ""computer  teacher** 
that  serves  In  a- "laboratory"  as  a  resource  to  many  other 
teachers  has  a  very  different  role  from  the  conventional 
Image  of  what  teachers  do.'  Other  new  professional  roles  and 
titles  and  circumstances  are  likely  to  emerge  as  schools  use 
television,  computers,  electronic  mall,  on-line  data  bases 
and  laser-d1sc*-based  data  bases  and  other  new  technologies. 

Two  other  dimensions  of  the  Introduction  of  new  technologies 
can  be  anticipated:   more  diverse  Instructional  strategies 
and  more  diverse  student  roles,  as  the  new  mediated  and 
Individualized  tools  become  commonplace. 

•  The  National  Assessment  of  Education  Progress  (NAEP)  Is  a 
vital  federal ly*-f1nanced  program  because  It  provides  a 
continuing  measuv*e  of  some  effects  of  our  schooling  system. 
This,  and  perhaps  other  "snapshots"  by  NtES  can  give  a 
picture  of  changing  student  attitudes  (that  Is,  attitudes 
that  schools  may  have  a  role  In  shaping)  to  supplement  data 
about  academic  learning. 

•  Four  topics  about  the  schooling  process  are  not  well  captured 
In  the  current  data  program  that  should  be  Improved  In  the 
next  decade,  as  they  are  likely  to  be  of  policy  concern: 

-  courses  available  to  students; 

-  populations  served  by  schools; 

-  off*-campus  learning;  and 

-  uses  of  new  technologies. 


We  recommend  special  attention  to  these  four  topics. 

New  administrative  procedures,  and  both  old  and  new 
technologies,  make  It  feasible  to  broaden  the  menu  of  courses 
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that  can  be  taught  even  in  the  smallest  schools.   On  the 
other  hand,  pressures  to  get  "back  to  basics"  and  to  shift 
academic  priorities  tend  to  reduce  the  menu  of  courses 
available  in  larger  schools..  What  to  teach,  and  how  to  make 
It  available,  are  constant  policy  topics  at  local  and  state 
levels.  Trend  data  would  be  helpful  here. 

The  federal  statistics  program  seems  to  define  public  schools 
in  K-12  terras.   Yet  schools  everywhere  are  looking  at 
pre-school  care,  after-school  care,  and  many  forms  of  adult 
education  and  services.   Whom  to  serve,  and  how  to  render 
services  to  new  populations,  are  policy  issues  at  local  and 
state  levels  which  NCES  may  be  able  to  illuminate  with  trend 
data. 

The  issue  of  on-campus  versus  off-campus  learning  suggests 
several  dimensions.   Technology  makes  home-based  learning 
more  feasible  and  school -building-based  learning  less 
necessary.   One  trend  is  the  growing  interest  by  some  school 
districts  in  uses  of  broadcast,  public  and  cable  television. 
Another  is  the  often  expressed  need  for  school /business 
collaboration;  related  is  a  pc  ential  for  greater 
collaboration  between  schools,  libraries,  museums  and  higher 
education  institutions. 

In  summary,  schools  are  likely  to  change  in  several  ways  durinj  the 
next  decade;  the  best  NCES  service  would  be  to  capture  significant 
trends  In  a  timely  wety. 

We  see  a  most  significant  trend  in  the  shift  in  the  public  debate  from 
debating  the  process  of  education  to  debating  its  effects.   NCES  data 
should  also  make  the  shift  to  facilitate  this  trend. 

We  hope  that  thes?  comments  and  recommendations  will  be  helpful  to  you 
as  you  participate  in  the  laudable  effort  to  improve  NCES  data  for 
practical  use  in  local  school  districts  throughout  America. 


Very  truly  yours. 


Executive  Director 
TAS/mk 

cc:   William  J.  Bennett 
Secretary  of  Education 
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RESEARCH  AND  DATA  NEEDS  FOR  SMALL/RURAL  SCHOOLS 


by 


Bruce  Barker 


Although  discussion  of  research  and  development  needs  for 
small/ rural  schools  is  becoming  more  prevalent,  the  state  of 
knowledge  and  information  currently  available  on  rural  education 
remains  incomplete  and  startlingly  inadequate.    The  first  National 
Seminar  on  Rural  Education  held  in  Washington,  D.  C.  in  May,  1979 
recognized  the  need  to  collect,  analyze,  and  compile  data  pertinent 
to  rural  education  (Flectcher,  1979/80).    Tamblyn  (1977)  indicated 
that  one  of  the  major  tasks  in  the  1980' s  for  rural  education  was  the 
need  to  conduct  basic  research  on  small  school  problems,  practices, 
and  unique  features.    Horn  (1981)  declared  .hat  one  of  the 
responsibilities  facing  universities  is  to  conduct  research  and 
collect  data  on  rural  schools.    And,  Nachtigal  (1979)  specifically 
stated  that  descriptive  data  are  needed  on  the  operation  of  K-12 
rural  school  systems  with  enrollments  cf  fewer  than  300  students, 
300-999  students,  and  1000-2500  students. 
The  Problem  of  Definitions  for  Rural  Education 

Lack  of  a  precise  definition  may  be  one  reason  rural  education 
has  received  little  attention  in  recent  years.    Rural  education  has 
been  a  difficult  entity  to  define  because  the  word  "rural"  has 
different  meanings  when  viewed  historically,  statistically,  or 
philosophically  (Salmon,  1980).    Furthermore,  the  concept  of  "rural 
education"  varies  from  state  to  state  and  region  to  region.  Both 
Texas  and  Oregon,  for  example,  define  a  small/rural  district  as 
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having  fewer  than  1000  students  (Barker,  1985).    Since  1970,  the  U.S. 
Census  Bureau  has  carefully  defined  the  rural  population  as 
consisting  of  all  persons  living  in  places  of  fewer  than  2500 
inhabitants  or  in  areas  of  extended  cities  with  a  population  density 
of  less  than  lOOG  persons  per  square  mile  (U.S.  Department  of 
Commerce,  1970) •    The  National  Advisory  Council  on  the  Education  for 
Disadvantaged  Children  uses  the  Census  Bureau's  definition  to  state 
that  a  rural  district  is,  therefore,  one  having  fewer  that  2500 
students  (Special  Report  on  Rural  Education,  1979).  Other 
definitions  include  those  of  the  American  Association  of  School 
Administrators  which  has  established  a  K-12  enrollment  of  2000  or 
less  as  a  small  district  and  the  National  Association  of  Secondary 
School  Principals  which  considers  an  enrollment  of  1000  or  less  to  be 
a  small  high  school  (Jinks,  1984). 

Some  of  these  definitions  imply  that  rural  America  collectively 
consists  of  all  our  society's  nonmecropolitan  areas*    Inference  is 
also  made  that  this  portion  of  our  society  is  basically  homogeneous 
in  nature  and  composition.    In  reality,  rural  America  is  a  vast  array 
of  diverse  nonmetropolitan  areas  which  may  be  internally  more 
homogeneous  that  most  urban  communities,  but  which  differ  widely  from 
each  other.    For  example,  an  island  hamlet  off  the  coast  of  Maine,  an 
AlasJcan  native  village  near  the  Arctic  Circle,  a  coal  mining  town  in 
West  Virginia,  a  ranching  area  in  Wyoming,  an  impoverished  community 
in  the  Mississippi  Delta,  a  ski  resort  section  of  Vermont,  or  a 
prosperous  grain  farming  region  in  Iowa  have  little  in  common,  except 
that  they  are  all  classified  by  the  Census  Bureau  as  rural  areas  of 
the  United  States  (Sher,  1977). 
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The  Lack  of  Attention  Given  Rural  schools 

Federal  statistics  reveal  that  59.5  million  Americans  live 
outside  designated  urban  areas  of  the  United  States  and  that  rural 
school  students  constitute  the  largest  minority  public  school 
population  in  this  country  (Treadway,  1984;  Sher,  1977).    Based  on 
the  Census  Bureau's  definition  of  "rural,"  nearly  two-thirds  of  the 
15,600  operating  public  so' tool  districts  located  in  the  United  States 
are  in  rural  areas  and  one  student  in  every  three  attends  an 
elementary  or  secondary  school  classified  as  rural  (REA  News,  1982:. 
Ironically,  however,  the  "lion's  share"  of  attention,  research  and  an 
over  balance  of  federal  and  state  financial  support  generally  go  to 
large  schools  in  metropolitan  areas.    Not  until  late  1983,  four  years 
after  the  establishment  of  the  U.  S.  Department  of  Education,  did 

^  that  federal  department  declare  a  "Rural  Education  and  Rural  Family 

Education  Policy  for  the  1980 's"  which  stated,  "Rural  education  shall 
receive  an  equitable  share  of  the  information,  services,  assistance, 
and  funds  available  from  and  through  the  Department  of  Education  and 
its  programs"  (ERIC  CRESS,  1983/84).    In  1983,  the  National  Center 
for  Education  Statistics  also  agreed,  for  the  first  time,  to  include 
small  and  rural  schools  of  under  300  students  as  a  separate  category 
for  data  collection  (REA  News,  1983).    Up  until  the  time  of  these  two 
actions,  national  policy  makers  and  researchers  had  paid  little 
attention  to  rural  schools. 
Rural  Education  Research  and  Data  Needs 

Among  the  expressed  goals  of  the  national  Rural  Education 
Association  is  to  encourage  "...  the  collection  and  dissemination 

^  of  .  .  .  statistical  data  and  other  appropriate  information  relating 
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to  rural  education"  (REA,  1980).    A  National  Rural  Education  Research 
Agenda  endorsed  by  the  Rural  Education  Association  calls  for  research 
relevant  to  rural  education  in  nine  broad  categories  (Barker  and 
Stephens,  1985). 

1.  Rural  school  effectiveness 

2.  Staff  development  and  professional  support 

3.  Curriculum  and  instruction 

4.  Taxonomy  of  rural  education 

5.  Federal,  State,  and  local  policies  impacting  rural  schools 
and  communities 

6.  Rural  school  finance 

7.  School  district  governance  and  organization 

8.  Assessment  of  rural  school  assumptions 

9.  Role  of  the  school  in  rural  development 

These  themes  may  not  encompass  all  of  the  research  needs  for 
small/rural  schools,  but  they  do  establish  the  major  areas  in  which 
research  is  to  be  focused.    Moreover,  data  collected  in  these  areas 
will  provide  policy  makers  and  rural  school  practitioners  information 
to  knowledgeably  affect  small/rural  schools  improvement. 

In  the  redesign  of  the  elementary  and  secondary  data  program 
conducted  by  the  National  Center  for  Education  Statistics,  the  Rural 
Education  Association  strongly  encourages  the  inclusion  of 
small/rural  schools  as  a  specific  category  in  the  collection  and 
reporting  of  data.    In  light  of  the  various  definitions  associated 
with  rural  education,  it  would  jeem  that  the  collection  and  reporting 
of  data  on  the  basis  of  school  district  enrollment  size  would  be  the 
most  utilitarian  approach.    Rural  schools  have  always  been,  and  will 
likely  continue  to  be,  characterized  by  smallness.    According  to  Sher 
(1977),  small  public  schools  and  small  school  districts  have  become 
increasingly  rare  in  America's  metropolitan  centers.    Urban  schools 
and  districts  have  gc.ierally  always  had  larger  student  bodies  than  J 
rural  ones.    With  continued  political  and  economic  pressure  to 
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centralize  schools,  the  issues  of  the  small  public  school,  will  become 
almost  exclusively  rural,  for  rural  areas  will  be  the  only  places 
such  public  school  exis*-  in  significant  numbers. 

In  the  collection  and  reporting  of  education  data,  the  Rural 
Education  Association  recommends  that  NCES,  whenever  possible,  break 
down  the  data  based  on  school  districts  of  fewer  than  300  students, 
300-S99  students,  1000-2500  students,  and  those  in  excess  of  2500 
students.    Such  a  classification  would  more  accurately  reflect  rural, 
suburban,  snd  urban  similarities  and  differences.    In  addition,  the 
availability  of  comparative  data  at  the  national  level  would  provide 
policy  analysts,  public  educators,  and  others  interested  in  education 
•  with  valuable  information  to  assess  American  public  education. 

^  Conclusion 

It  is  impossible  to  treat  rural  education  as  one  single  or 
common  entity.    Rural  education  encompasses  everything  from  a 
one-room  country  schoolhouse  in  northern  Vermont  to  a  sparsely 
populated  western  school  district  responsible  for  education  in  a 
several  hundred  square  mile  region.    It  includes  districts  having 
solid  financial  resources  and  others  with  very  limited  funding 
sources.    Some  of  America's  fastest  growing  districts,  as  well  as 
those  experiencing  the  most  rapid  enrollment  decline,  are  in  rural 
areas.    Because  of  this  diversity,  much  of  the  effort  put  forth  to 
improvt^  rural  schools  can  best  be  met  at  the  local  level,  where  area 
specific  problems  can  be  addressed  and  treated. 

It  is  not  expected  that  the  collection  and  reporting  of  national 
data  on  the  basis  of  public  school  district  enrollment  size  will 

^  solve  the  many  challenges  facing  rural  educators.    Such  information 
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will,  however,  enable  local  administrators  to  more  knowledgeably 
assess  the  operation  and  management  of  their  own  school  systems  and 
\all  provide  them  with  reference  information  on  school  systems  of 
similar  size.    In  our  nation's  quest  for  excellence  in  education,  the 
data  and  information  needs  for  small/rural  schools  must  be  included 
<n  any  collection  of  statistics  conducted  by  the  National  center  for 
Education  Statistics. 
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SHEEO/NCES  COMMUNICATION  NETWORK 

Suite  31 0  •  1 860  Lincoln  Street  •  Denver.  Colorado  80295  •  (303)  830-3687 


October  1,  1985 


Mr.  Enerson  Elliult 
Administrator 

National  Center  for  Education 

Statistics 
Brown  Building,  Room  606 
1200  19th  Street,  N.W. 
Washington,  D.C.  20208-1404 

Dear  Mr.  Elliott: 

I  am  pleased  to  provide  you  with  some  ideas  on  the  NCES  project 
to  redesign  its  elementary  and  secondary  education  data 
program.    This  is  an  important  NCES  initiative.    We  applaud  the 
Center's  effort  to  solicit  advice  from  various  persons  and 
associations  on  how  NCES  might  improve  these  data.    The  conments 
which  follow  were  prepared  by  the  State  Higher  Education 
Executive  Officers/National  Center  for  Education  Statistics 
Communication  Network  Advisory  Committee.     I  transmit  them  to  you 
on  behalf  of  tY.2  State  Higher  Education  Executive  Officers 
Association. 

Most  SHEEO  agencies  use  national  pos tsecondary  education 
statistics  available  from  NCES  in  a   /ariety  of  ways.  By 
comparison,  their  use  of  national  elementary/secondary  education 
statistics  has  been  limited.    Historically,  this  has  been  so 
because  much  of  the  elementary/secondary  data  used  by  the 
agencies  has  been  obtained  from  their  respective  state 
departments  of  education.    Many  agencies  have  not  taken  advantage 
of  relating  nati onaT elementary/secondary  data  to  national 
postsecondary  data.    Recently,  however,  the  emphasis  upon 
education  reform  at  all  levels  within  the  states  has  generated 
the  need  to  address  interrelated  elementary,  secondary  and 
postsecondary  issues  and  problems.    There  are,  therefore,  some 
important  general  conments  we  feel  need  to  be  considered  by  NCES 
as  the  Center  works  toward  redesigning  and  improving  its  national 
elementary/secondary  data  collection  program. 

Many  education  policy  issues  in  the  states  and  at  the  national 
level  bridge  elementary,  secondary  and  postsecondary  education. 
NCES  data  collections  from  all  sources  and  levels  of  education 
should  be  compatible  so  the  totality  of  the  educational 
enterprise  and  its  continuity  can  be  reflected  in  the  data 
analysis.    We  need  the  capacity  to  assess  changes  in  the 
educational  process  at  transitional  points  along  the  education 
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continuum.    The  same  definitions  should  be  applied  to  NCES 
student  and  institution  based  survey  data  so  students  can  be 
tracked  from  one  level  of  education  to  the  next.    Analysts,  as  a 
result,  should  be  able  to  reliably  generalize  sampled  data  to  the 
population  (i.e.  the  sampled  data  f rom  NLS-88  can  be  generalized 
for  students  in  the  IPEDS  universe  of  institutions). 
Elementary/secondary  data  collections  need  to  be  compatible  and 
linked  to  the  NCES  Integrated  Postsecondary  Education  Data  System 
(IPEDS)  surveys  to  make  possible  the  ability  to  interrelate  the 
data.'  By  ihterrelat ing  the  data  bases,  NCES  will  be  able  to  show 
more  clearly  the  multi-dimensional  character  of  education,  and 
thereby  demonstrate  the  need  to  address  many  educational  problems 
at  more  than  one  area  of  the  education  spectrum. 

It  is  important  that  NCES  improve  upon  both  what  data  are  being 
collected,  and  upon  how  the  data  are  collected.    Thus,  another 
important  element  of  this  redesign  effort  is  the  use  of  current 
technologies  for  collecting,  transmitting,  and  disseminating  the 
data  to  be  collected.    The  timeliness,  quality  and  utility  of  the 
NCES  data  for  researchers,  administrators^  state  and  national 
policy  makers  can  be  improved  if  the  use  of  technology  to  collect 
and  disseminate  data  is  an  integral  part  of  the  total  redesign 
initiative. 

Beyond  these  general  comments,  there  are  some  specific  data 
elements,  and  related  information  that  are  needed  by 
postsecondary  analysts  which  should  be  a  part  ot  the  NCES 
elementary/secondary  education  data  collection  program.  The 
availability  of  such  data  will  be  of  assistance  to  postsecondary 
education  policy  planning  and  development  at  the  state  and 
national  levels. 

1.    Enrol Iments  in  public,  private  and  specialized  (sta\e 
schools  for  the  deaf  and  blind,  etc.),  high  schools,  and 
enrollments  in  school-sponsored,  home-study  programs. 
The  enrollment  needed  annually  from  the  universe  of 
schools  include  students  in: 

a.  Grades  7,  8,  9,  10,  11,  12  by  sex,  age  and  ethnicity; 

b.  College  preparatory,  vocational  and  general 
curricular  tracks  for  twelfth  graders  by  sex  and 
ethnici  ty; 

c.  Joint  high  school /col legiate  level  programs; 

d.  Third  and  fourth  year  English,  mathematics,  science 
and  f ore ign  language  courses  for  grade  levels  11  and 
12; 

e.  Different  kinds  of  remedial  courses  and  programs  at 
the  se?ondary  and  postsecondary  levels  by  sex  and 
ethnici  ty . 
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2.  Number  of  high  school  graduates  from  public,  private  and 
specialized  high  schools.     The  number  of  high  school 
diploma  recipients  need  to  be  available  annually  from  the 
universe  of  schools  by  sex,  age  and  ethnicity. 

3.  A  survey  regarding  elementary  and  high  school  personnel 
for  the  purpose  of  determining: 

a.  Analysis  of  staff  turnover  in  terms  of  "quit  rates"; 

b.  Percentage  of  high  school  teachers  teaching  out-of- 
field; 

c.  Measures  of  teacher  quality  (i.e.  experience,  degrees 
held|  test  scores,  self-reported  grade  point  average 
in  college,  etc.) 

4.  Other  information  to  be  provided  throiigh  data  analysis 
(that  perhaps  can  be  derived  from  existing  data)  include: 

a.  The  participation  rates  of  students  from  different 
types  of  secondary  schools  enrolling  in  different 
types  of  postsecondary  institutions; 

b.  An  analysis  of  the  secondary  school  courses  taken  by 
former  high  school  students  enrolling  in  different 
types  of  postsecondary  education  institutions,  and 
the  relationship  of  such  course  work  to  previous 
academic  achievement  and  test  scores  in  elementary 
schools. 

c.  Basic  indicators  of  the  progress  being  made  in 
improving  the  condition  of  education  at  all  levels. 

5.  Analyses  of  student-based  longi tudinal. studies  that  need 
to  be  continued  include: 

a.  High  school  drop-out  rates  from  all  kinds  of  schools, 
including  private  and  specialized,  by  grade  level, 
sex  aiiJ  ethnicity; 

b.  Average  achievement  test  scores  for  students  by  type 
of  high  school  (public,  private,  specialized), 
location  of  school  (rural,  suburban,  city), 

curr  icular  track  (college  preparat  ion,  vocational , 
general),  by  student  sex  and  ethnicity;  and 

c.  Intentions  of  high  school  seniors  regarding  work, 
military,  or  education  upon  completion  of  their 
secondary  schooling  with  a  six-month  follow--up  to 
determine  the  extent  intentions  are  valid  predictors 
of  actual  decisions  made. 
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School-based  survey  data,  similarly  to  postsecondary  institution- 
based  data,  provide  essential  information  for  particular 
purposes.    Obviously,  NCES  should  continue  to  collect  such 
data.     In  Addition,  student-based  survey  data  are  becoming 
increasingly  important.    Many  policy  issues  related  to  drop-outs, 
remediation,  and  student  course  work  and  achievement  can  only  be 
addressed  through  the  NCES-sponsored,  student-based,  longitudinal 
studies.    The  information  gathered  through  these  studies  may,  in 
the  future,  be  the  most  important  elementary/secondary  education 
data  series  NCES  sponsors. 

At  its  annual  meeting  in  July  1985,  SHEEO  adopted  several 
recommendations  it  received  from  its  SHEEO/NCES  Network 
Representatives  following  their  national  meeting  in  June  (see 
attachment ) .     Several  reconrnendat ions  relate  to  improving  the 
relevance,  technical  quality  and  utility  of  NCES  data  programs  to 
better  serve  education  policy  makers  at  all  levels. 
Implementation  of  these  recommendations  will  improve  NCES' 
elementary/secondary  and  postsecondary  education  data 
collections.    Reconrnendat ions  1,  5,  6,  14,  15  and  16  should  be 
considered  when  redesigning  NCES*  elementary  and  secondary 
education  data  collections. 

On  behalf  of  the  SHEEO  Association,  I  thank  you  for  this 
opportunity  to  provide  our  thoughts  on  the  elementary/secondary 
redesign  project.    Please  contact  me  for  further  elaboration  on 
these  comments  if  needed. 


Sincerely 9 


John  R.  Wittstruck,  Director 
SHEEO/NCES  Communication  Network 


JEW: as 


cc:    Kenneth  Ashworth,  SHEEO  President 

SHEEO/NCES  Network  Advisory  Committee 
Leslie  J.  Silverman,  NCES 
Richard  C.  Taeuber ,  NCES 
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/[.     .\  U.S.  EQUAL  EMPLOYMENT  OPPORTUNITY  COMMISSION 

•  I  Washington.  D.C.  20507 


Mr.  Leslie  J.  Silverman 
Deputy  Assistant  Administrator 
Division  of  Statistical  Services 
National  Center  for  Education  Statistics 
Department  of  Education 
Brown  Building  #413A 
1200    19th  Street,  N.W. 
Washington,  D.C. 

Dear  Mr.  Silverman: 

The  U.S.  Equal  Employment  Opportunity  Commission  Is  pleased  to  participate 
In  the  National  Center  for  Education  Statistics'  effort  to  re-evaluate 
and  redesign  Its  data  collection  system.    We  applaud  your  long-term  plans 
to  Improve  your  responsiveness  to  the  needs  of  various  users  by  providing 
"cross-sectional  and  longitudinal  data  relevant  to  policy  Issues  and  ad- 
ministrative needs,  as  well  as  to  measurement  of  our  Nation's  education 
systems." 

Our  input  to  the  project  consists  of  two  parts.    First,  with  regard  to  the 
kind  of  data  that  NCES  might  consider  collecting,  we  are  providing  the 
following  general  and  specific  recommendations  whose  thrust  Is  toward  the 
Increased  use  of  case  studies  and  ethnographic  research: 

1.  Collecting  data  at  elementary  and  secondary  school 
levels  Indicating  actual  enrollees  by  race  and  ethnic 
categories; 

2.  Developing  qualitative  Indicators  of  primary  and  elementary 
school  preparation  showing  self-perception,  motivatlca  to 
learn,  and  orientation  toward  school  and  the  world  out- 
side of  family  and  neighborhood; 

3.  Providing  interpretive  analyses  of  Di^,est  of  Education 
Statistics  tables  and  data  sets; 

A.    Collecting  data  at  both  elementary  and  secondary  school 
levels  on  drop-out  rates  by  race  and  ethnic  categories • 
Also  providing  case  studies  of  successful  retention 
programs,  incidences  of  high  drop-out  rates,  and  number 
of  drop-outs  who  return  and  complete  their  studies; 

5.    Ethnographic  studies,  particularly  in  urban  areas »  on  how 
minority  students  "move  through"  the  syst^im,  with  emphasis 
on  barriers  and  "tracking;" 
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6«    Case  studies  of  the  correlation  between  levels  of  edu- 
cation and  emplo3niient  by  race  and  ethnic  group,  in 
terms  of  income  levels,  unemployment  and  underemploy- 
ment; 

7.  Collecting  data  on  students  "tracked"  during  elementary 
and  secondary  school  as  enrollees  in  general  education 
curriculumi  vocational  education  curriculum,  or  col* 
lege  preparatory  curriculum; 

8.  Case  studies  of  ''more  effective"  and  "less  effective" 
school  systems  and  programs; 

9*    Case  studies  comparing  public  and  private  schools  — 
In  terms  of  enrollments  by  race  and  ethnic  group, 
quality  indicators,  objectives,  value  systems, 
teaching  techniques,  administration,  and  school 
organization. 


Second,  in  response  to  your  Invitation  to  submit  papers  addressing  select 
education  topics,  we  are  Including  with  this  letter  two  separate  papers 
that  discuss  the  relationship  between  equal  employment  opportunity  and 
equal  educational  opportunity*    More  specifically,  the  papers  address 
the  critical  issues  of  family,  education  and  eu^ployment,  with  particular 
emphasis  on  minority  communities*    These  essays,  as  well  as  a  third  paper 
that  will  be  sent  to  you  next  week,  serve  as  the  foundations  on  which  the 
above  recommendations  rest. 

We  ask  that  you  review  these  papers  as  "drafts"  and  not  consider  these 
as  reflective  of  official  Commission  policy.    Our  intention  is  to  pro- 
vide research  papers  for  the  purpose  of  stimulating  public  debate  on  the 
nexus  between  employment  and  education. 

For  any  further  information  regarding  any  aspect  bf  our  package,  please 
contact  the  respective  authors  or  Mark  Wong  at  634-6750. 


Office  of  F^gram  Research 
Enclosures 
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NATIONAL  SCIENCE  FOUNDATION 

WASHINGTON  DC  20550 


Directorate  for  Science 
and  Engineering  Education 


June  19,  1985 


Mr.  Leslie  J.  Silverman 
Deputy  Assistant  Administrator 
Division  of  Statistical  Services 
National  Center  for  Education  Statistics 
1200  19th  Street,  N.W. 
Washington,  D.C.  20208-1401 

Dear  Les: 

I  regret  that  I  was  not  able  to  attend  the  May  28th  meeting  to  discuss  the 
redesign  of  NCES'  elementary  and  secondary  education  data  program.    In  my 
absence.  Iris  Rotberg  represented  NSF  at  that  meeting. 

In  response  to  your  request  for  papers,  NSF  Is  sponsoring  two  projects  at 
the  National  Academy  of  Sciences/National  Research  Council  (NRC)  that  are 
of  direct  relevance  to  your  review.   One  of  these  studies  represents  a 
year-long  effort  by  the  Committee  on  Indicators  of  Precollege  Science  and 
Mathematics  Education,  which  was  charged  with  proposing  a  framework  for  an 
efficient  set  of  Indicators,  filling  In  the  framework  to  the  extent 
possible  with  existing  data,  and  suggesting  data  and  data  analyses  that 
will  be  needed  in  the  future  for  a  continuing  portrayal  of  the  condition  of 
precollege  science  and  mathematics  education.   NSF  Is  presently  supporting 
a  successor  committee  under  the  chairmanship  of  John  G.  Truxall  of  the 
State  University  at  Stony  Brook,  which  Is  addressing  the  Important  goal  of 
developing  Imaginative  new  Indicators.   Jay  Noel  of  NCES  has  been  attending 
the  meetings  of  the  successor  committee  and  has  a  copy  of  the  Initial 
report. 

The  second  project  concerns  the  supply,  demand,  and  qualifications  of 
teachers  of  science  and  mathematics.    Under  NSF  sponsorship,  the  Committee 
on  National  Statistics  held  a  conference  on  August  9-10,  1984  to  Identify 
problems  with  the  available  data,  or  gaps  In  the  data,  to  discuss  problems 
and  possible  Improvements  In  the  models  now  used  for  estimating  and 
projecting  supply  and  demand,  and  to  suggest  activities  for  a  follow-on 
study.    Frank  Corrlgari  of  NCES  has  a  copy  of  the  conference  report  and,  as 
you  may  know,  NCES  is  presently  In  the  process  of  transferring  funds  to  NSF 
to  support  part  of  a  new  effort  that  will  be  based  on  recommendations  from 
the  August  9-10  conference. 

I  am  enclosing  copies  of  the  Introductory  sections  of  both  of  these  reports 
that  you  may  wish  to  use  In  addition  to  this  letter,  as  official 
submissions  for  public  comment.   Of  course,  the  NRC  activities  as  they 
progress  will  probably  have  Important  Implications  for  the  NCES  redesign 
efforts. 
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In  terms  of  specific  comments  about  NSF's  present  needs  from  NCES* 
elementary  and  secondary  data  program »  I  have  the  following  comments: 

1.  NCES  data  on  teacher  supply  and  demand  and  course  offerings  and 
enrollment  are  not  broken  down  in  sufficient  detail  to  be  useful  to  NSF  for 
planning  purposes.   The  notable  exception  is  the  1982  transcript  data  from 
High  School  and  Beyond »  which  produced  enrollment  data  on  detailed 

of  science  courses  (such  as  physics,  chemistry »  and  earth  sciences)  and 
mathematics  courses  (such  as  algebra  I,  algebra  II,  geometry,  trigonometry, 
and  calculus). 

2.  Time  series  data  on  course  enrollment  in  science  an^^  mathematics 
disciplines  are  largely  lacking.    NCES  should  have  more  consistency  in  the 
design  of  surveys,  data  collection,  and  analysis.   Also,  more  and  better 
data  are  needed  on  the  amount  of  time  students  spend  on  homework. 

3.  The  most  significant  determinant  of  teacher  demand  projections  are 
turnover  rates  (which  appear  to  be  age  specific).  Yet  NCES  data  on  teacher 
turnover  rates  are  several  years  out  of  date  and  even  these  earlier  data 

/  are  not  age  specific.   Again,  NCES  projections  of  teacher  demand  are  not 

^  broken  down  by  science  and  mathematics  disciplines. 

4.  Supply  projections  are  largely  dependent  on  new  teacher  graduates. 
NCES  uses  the  questionable  practice  of  projecting  new  teacher  graduates 
based  on  estimates  of  percentages  of  total  bachelors  degrees  granted  and 
these  estimates  are  aggregated  so  that  data  on  science  and  mathematics 
disciplines  are  not  available. 

5.  Almost  no  data  are  available  on  the  reserve  pool  of  teachers  and 
the  number  who  return  to  teach. 

6.  The  NCES  practice  of  counting  teacher  vacancies  leaves  a  lot  to  be 
desired  in  trying  to  determine  the  extent  of  shortages  of  qualified 
teachers  of  science  and  mathematics.    For  example,  there  is  evidence  that 
many  science  and  mathematics  teachers  are  teaching  out-of-field  because  of 
shortages.   Also,  it  is  not  clear  whether  a  teacher  certified  in  both 
mathematics  and  chemistry  would  be  counted  as  a  mathematics  or  a  chemistry 
teacher,  or  both. 

7.  Adequate  information  is  lacking  on  the  qualifications  of  teachers 
who  are  responsible  for  teaching  science  and  mathematics  in  high  school, 
middle  school,  and  elementary  school.    In  many  instances,  certification  is 
not  a  good  proxy  for  teacher  qualifications  because  of  disparate 
certification  practices  of  states.   We  also  need  to  have  more  data  on  these 
state  certification  practices. 

^  8.    In  terms  of  curriculum  content,  periodic  surveys  should  be 

conducted  of  use  of  various  science  and  mathematics  textbooks  at  each  grade 
level.   Surveys  of  textbook  use  should  be  followed  by  content  analysis  of 
^        the  most  frequently  used  textbooks. 
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I  appreciate  the  high  degree  of  cooperation  that  you  and  your 
collegues  at  NCES  have  had  with  NSF  in  the  recent  past  and  I  look  forward 
to  working  with  you  on  these  issues  in  the  future. 

Sincerely  yours, 

Richard  Barry 
Program  Director 
Studies  and  Analyses 

Enclosures 

cc:    W.  Gillespie,  SEE 
I.  Rotberg,  SEE/OSPA 
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THE  OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 


WASHINGTON.  D.C.  20301-4000 


1AU6  1985 


FORCE  MANAGEMENT 


AND  PERSONNEL 

(Military  Personnel  &  Force  Managemeni 


Mr.  Leslie  J.  Silvermar 

National  Center  for  Education  Statistics 

1200  19th  Street,  N.W.  ^ 

Washington,  D.C.  20208-1401 

Dear  Mr.  Silverman: 

As  we  discussed  at  our  July  19,  1985  meeting,  the  Department  of 
Defense  would  be  pleased  to  participate  in  the  Elementary/Secondary  Education 
Data  Program  Redesign  Project  and  we  ha^  specific  data  we  would  like  you  to 
consider  collecting  on  oar  behalf. 

Our  secondary  school  data  collection  request,  outlined  on  the  attachment, 
stems  from  our  need  for  current,  consistent  and  reliable  data  in  support  of 
military  recruiting.  Specifically,  a  key  portion  of  the  Recruit  Market  Network 
(RMN),  a  major  DoD  data  base  available  tc  recruiters  through  a  nationwide 
teleprocessing  network,  includes  information  about  the  high  school  population. 
Because  the  high  school  data  for  inclusion  in  the  RMN  is  derived  largely  from 
recruiters,  private  firms,  and  secondary  sources,  we  would  be  delighted  to 
replace  these  sources  with  your  data. 

If  you  have  questions  about  the  attachment  or  plan  to  host  future  meetings 
on  this  topic,  we  would  appreciate  your  contacting  Zahava  D.  Doering,  Chief, 
Survey  and  Market  Analysis  Division,  Defense  Manpower  Data  Center,  at  696-5826. 
Dr.  Doering,  or  members  of  her  staff,  will  attend  relevant  meetings  and  can 
provide  additional  information. 


Sincerely 


Anita  R*  Lancaster 
Assistant  Director 
Accession  Policy 


Attachment 
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HIGH  SCHOOL  INFORMATION  AND  DATA  TO  SUPPORT  MILITARY  RECRUITING: 


REQUIREMENTS 


Background 

0  The  Recruit  Market  Network  (RMN)  is  a  common  data  base,  available  to 
users  (on-line)  through  a  teleprocessing  network,  established  to  support 
recruiting  efforts  in  the  Military  Services. 

0  A  key  portion  of  the  RMN  is  devoted  to  information  about  the  nation's 
high  school  population,  organized  in  ways  to  aid  decision  makers  in  allo- 
cating their  resources. 

0  The  cataloguing,  tabulating  and  associated  problems  of  determining 
school  locations,  current  enrollment  characteristics,  and  public  and  private 
school  inventories  has  remained  an  on-going  problems  for  recruiters,  mana- 
gers, and  DoD  officials. 

0  Data  currently  available  from  the  National  Center  for  Education 
Statistics  (NCES)  does  not  provide  the  required  detailed  data. 


0  Provide  the  recruiting  community,  through  the  RMN,  with  a  reliable, 
up-to-date,  efficient,  data  base  containing  information  on  the  nation's 
high  schools. 

0  Eliminate  the  need  to  utilize  recruiters,  private  firms,  and  secon- 
dary data  sources  for  this  information. 

Requirements     (each  school) 

0  The  RMN  requires  a  data  file  with  a  record  for  every  high  school 
which  provides  the  following  information: 

-  Type  of  School 

—  Public 

—  Catholic 

—  Private  (Non-Catholic) 

—  Vocational 

-  School  Location 

—  City 

—  County 

—  State 

—  Zip-Code 


Objective 


School  District 
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•  Senior  Class  enrollment  counts,  by  sex  and  race/ethnic 

-  Junior  Class  enrollment  counts,  by  sex  and  race/ethnic 

-  Previous  Year's  graduates  counts,  by  sex  and  race/ethnic 

-  Percentage  attending  college  (for  previous  years'  graduates) 
0  These  d?ta  elements  are  needed  on  an  annual  basis 


( 


r>gg  11  July  1985 
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